Jobs → Data & Analytics → Azure Data Engineer

About the Role We are looking for an experienced Azure Data Engineer to join our team. This role focuses on developing scalable data pipelines and supporting cloud-based data engineering solutions. Key Responsibilities • Design, develop, and maintain ETL/ELT data pipelines using Azure Data Factory (ADF) • Develop data processing and transformation solutions using Azure Databricks and PySpark • Use Python/PySpark for data extraction, transformation, cleansing, and validation • Write complex SQL queries for data transformation, analysis, and validation • Integrate data from multiple sources into Azure data platforms • Implement data quality, error handling, logging, and pipeline monitoring • Optimize Databricks jobs, Spark workloads, and SQL queries for performance • Collaborate with business analysts, architects, and development teams to understand data requirements • Troubleshoot data pipeline failures and resolve performance and data-quality issues Requirements • Strong hands-on experience in Azure Data Factory (ADF), Databricks, Python/PySpark, and SQL • Experience in developing scalable data pipelines and transforming large datasets • Knowledge of cloud-based data engineering solutions • Ability to work in a hybrid work environment