Azure Data Engineer
Dimpal KhandelwalRemoteSENIORPosted 13d ago
Azure Data bricksPysparkPythonAzure Data FactoryData LakeMigrationAzure Synapse AnalyticsAzure Data Lake StorageSQLAzure DevOpsGitPower BI
About the Role
We are seeking an experienced Azure Data Engineer to design, develop, and maintain scalable data solutions on Microsoft Azure. This role involves building and optimizing ETL/ELT pipelines and implementing data integration solutions.
Key Responsibilities
• Design, develop, and maintain scalable data solutions on Microsoft Azure
• Build and optimize ETL/ELT pipelines using Azure Data Factory (ADF) and Azure Databricks
• Develop data integration solutions using Azure Synapse Analytics and Azure Data Lake Storage (ADLS)
• Write and optimize complex SQL queries, Python, and PySpark code for data processing
• Implement CI/CD pipelines using Azure DevOps or GitHub Actions
• Monitor, troubleshoot, and optimize data pipelines for performance and reliability
• Stay updated with Azure services and recommend improvements to the data platform
Requirements
• 12+ years of experience in Data Engineering
• At least 8+ years of experience in Azure Data Factory, Azure Databricks, Azure Synapse Analytics, ADLS Gen2, SQL, Python, PySpark, Azure DevOps, Git
• 6–10+ years in Data Engineering with at least 3–5 years of hands-on experience in Microsoft Azure