Jobs → Data & Analytics → Azure Data Engineer

About the Role We are seeking an Azure Data Engineer to design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and PySpark. This role involves developing ETL/ELT workflows and building data processing solutions. Key Responsibilities • Design and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and PySpark • Develop and optimize ETL/ELT workflows for structured and unstructured data • Build data processing solutions using Apache Spark, PySpark, and Spark SQL • Work with Azure Data Lake Storage Gen2 and Delta Lake for data storage and management • Implement Medallion Architecture for data processing and analytics • Develop and optimize SQL queries, data models, and transformation logic • Implement incremental data loads, change data capture, and data quality checks • Optimize Spark jobs and Databricks workloads for performance and efficiency • Manage data orchestration, scheduling, monitoring, and error handling • Implement data security, access controls, and governance • Collaborate with data architects, analysts, BI developers, and business stakeholders • Troubleshoot data pipeline failures and maintain data accuracy • Use Git and CI/CD pipelines for code versioning and deployment