Azure Data Engineer
Vamshi S.R.United StatesMIDPosted 2h ago
Azure Data FactoryAzure DatabricksPythonPySparkSQLETLELTData TransformationData ValidationData QualityPerformance TuningTroubleshooting
About the Role
We are looking for an experienced Azure Data Engineer to join our team. This role focuses on building scalable data pipelines and cloud-based data engineering solutions.
Key Responsibilities
• Build scalable data pipelines using Azure Data Factory and Azure Databricks
• Develop ETL/ELT processes for data transformation, validation, and quality
• Perform performance tuning and troubleshooting of data solutions
• Utilize Python/PySpark for data processing tasks
• Implement advanced SQL queries for data extraction and manipulation
Requirements
• Strong hands-on expertise in Azure Data Factory (ADF) and Azure Databricks
• Proficiency in Python/PySpark for data engineering tasks
• Advanced SQL skills for data manipulation
• Experience in ETL/ELT pipeline development
• Knowledge of data transformation, validation, and quality processes
• Skills in performance tuning and troubleshooting of data solutions