Jobs → Data & Analytics → Azure Databricks Engineer

About the Role We are looking for an experienced Azure Databricks Engineer to join our team. This role focuses on building scalable data pipelines and modern cloud data platforms. Key Responsibilities • Design and implement scalable data pipelines • Develop and optimize modern cloud data platforms • Utilize Azure Databricks and Azure Data Factory • Work with PySpark, Spark SQL, Python, and SQL • Develop ETL/ELT pipelines • Implement Delta Lake and Medallion Architecture • Utilize Azure Data Lake Storage (ADLS Gen2) • Optimize Spark job performance • Perform data modeling, data quality, and governance • Implement Azure DevOps and CI/CD pipelines • Handle data ingestion, transformation, and pipeline monitoring Requirements • Hands-on experience designing, developing, and optimizing data engineering solutions • Strong expertise in Azure data services • Experience with PySpark, Spark SQL, Python, and SQL • Knowledge of ETL/ELT pipeline development • Familiarity with Delta Lake and Medallion Architecture • Experience with Azure Data Lake Storage • Understanding of Spark job performance optimization • Skills in data modeling, data quality, and governance • Experience with Azure DevOps and CI/CD pipelines • Ability to handle data ingestion, transformation, and pipeline monitoring