Jobs → Data & Analytics → Azure Databricks Architect

About the Role We are seeking an experienced Azure Databricks Architect to design, architect, and implement scalable, secure, and high-performance data engineering and analytics solutions on Microsoft Azure. Key Responsibilities • Design and implement end-to-end data lakehouse architectures using Azure Databricks and Delta Lake • Define scalable frameworks for batch and streaming workloads • Architect modern data platforms with Azure Data Lake Storage Gen2, Azure Data Factory, and Azure Synapse Analytics • Establish data architecture standards, design patterns, and best practices • Develop and optimize ETL/ELT pipelines with PySpark, Spark SQL, and Delta Lake • Implement medallion architecture (Bronze, Silver, Gold) • Design secure data access with Entra ID, RBAC, Unity Catalog, and managed identities • Configure and optimize Databricks clusters, jobs, workflows, and autoscaling • Implement CI/CD pipelines with Azure DevOps or GitHub Actions • Drive data governance, quality, lineage, and monitoring standards • Mentor data engineers and lead architecture reviews Requirements • Extensive experience architecting enterprise-scale data platforms with Azure Databricks • Strong hands-on expertise in Apache Spark, PySpark, Spark SQL, Delta Lake • Deep knowledge of Azure Data Lake Storage Gen2 and Azure data services • Experience with lakehouse & medallion architecture • Expertise in Spark performance tuning, partitioning, caching, and optimization • CI/CD and Infrastructure as Code implementation • Proficiency in Python, SQL, Git workflows • Excellent communication and leadership skills Preferred Qualifications • Experience with ADF, Synapse, Event Hubs, Azure Functions • Knowledge of Structured Streaming, Kafka • Experience with Terraform or Bicep • Familiarity with Microsoft Purview • Azure/Databricks certifications are a plus Experience • 10+ years in data engineering, with 5+ years in Azure data platforms and substantial Databricks architecture experience