Jobs → Data & Analytics → Azure Databricks Architect

About the Role We are looking for an experienced Azure Databricks Architect to join our team. This role focuses on designing, building, and optimizing enterprise-scale Data Lakehouse platforms, preferably within the financial services domain. Key Responsibilities • Design and implement enterprise-scale Data Lakehouse platforms • Lead a team of 10+ Data Engineers • Optimize performance and cloud costs • Drive engineering best practices • Implement data governance and security measures Requirements • 14+ years of experience in Azure Databricks and Apache Spark • Strong hands-on experience with PySpark, Python, SQL, and Delta Lake • Expertise in designing and implementing Lakehouse architecture • Hands-on experience with Unity Catalog and data governance • Experience with cluster provisioning, policies, auto-scaling, and cost optimization • Strong Spark performance tuning and ETL optimization experience • Experience with Azure Data Lake Storage (ADLS Gen2) and Azure cloud services • Experience implementing CI/CD pipelines using Azure DevOps and Git • Strong technical leadership experience managing and mentoring 10+ Data Engineers • Experience with enterprise data security, access controls, and compliance Benefits • Long-term contract opportunity • Opportunity to work on large-scale data engineering initiatives