Jobs → Data & Analytics → Azure Databricks Engineer

About the Role We are seeking experienced Databricks / Azure Consultants to support the design, implementation, and ongoing development of the Databricks data platform. This role involves building and enhancing scalable data solutions using Databricks and Microsoft Azure, with a focus on data engineering, integration, security, automation, and platform best practices. Key Responsibilities • Work with technology and data teams to build and enhance scalable data solutions • Design and implement solutions using Databricks and Microsoft Azure • Focus on data engineering, integration, security, automation, and platform best practices • Collaborate across application development, infrastructure, cloud, security, architecture, and data teams Requirements • Hands-on experience with Databricks Workspace, Unity Catalog, Delta Lake, Spark UI, and MLflow • Strong development experience with Python, PySpark, SQL, and/or Java • Experience developing and optimizing data processing and ETL/ELT pipelines • Strong Microsoft Azure experience, particularly Azure Databricks, Azure Data Lake Storage Gen2, and Azure Data Factory • Experience with Apache Spark, including developing, troubleshooting, and performance-tuning Spark-based workloads • Experience with Git, CI/CD pipelines, OpenShift, Kubernetes, and Terraform / Infrastructure as Code • Experience implementing or supporting Databricks security, access controls, secrets management, identity integration, data governance, and Unity Catalog • Experience with Databricks workflows, job orchestration, monitoring, troubleshooting, performance optimization, and production support • Ability to collaborate across technical teams and operate within established enterprise architecture, security, change-management, and governance standards • Knowledge of Apache Airflow