Data Engineer
Poonam KumariUnited StatesMIDPosted 5d ago
Data EngineeringETLAzure Data FactoryAzure SynapseADLS Gen2SQLPythonPySparkSpark SQLREST API integrationJSON data validationPower BIPower QueryParquetDelta LakeGitAzure DevOpsCI/CD
About the Role
We are looking for a Data Engineer to join our team at ChurnZero. This role focuses on building and maintaining data pipelines and ETL processes.
Key Responsibilities
• Design and implement ETL processes using Azure Data Factory and Azure Synapse
• Develop and maintain data pipelines using PySpark and Spark SQL
• Integrate REST APIs and validate JSON data
• Transform and migrate data using Power BI and Power Query
• Build incremental ETL pipelines with Parquet and Delta Lake
• Utilize Git and Azure DevOps for CI/CD
Requirements
• 10+ years of Data Engineering / ETL experience
• Strong knowledge of Azure Data Factory (ADF), Azure Synapse, and ADLS Gen2SQL
• Proficiency in Python, PySpark, and Spark SQL
• Experience with REST API integration and JSON data validation
• Familiarity with Power BI / Power Query transformation migration
• Knowledge of Parquet, Delta Lake, and incremental ETL pipelines
• Experience with Git, Azure DevOps, and CI/CD