Azure Data Engineer
Naveen Kumar ReddiUnited StatesMIDPosted 12d ago
AzurePySparkPythonSQLAzure Data FactoryAzure DatabricksAzure Data Lake Storage Gen2Azure Synapse AnalyticsETLELTDelta LakeParquetCSVJSONGitAzure DevOpsCI/CD
About the Role
We are looking for an experienced Azure Data Engineer to join our team. This role focuses on designing, developing, and maintaining scalable data pipelines and ETL/ELT processes.
Key Responsibilities
• Design and develop scalable data pipelines and ETL/ELT processes
• Maintain and optimize data solutions on Microsoft Azure
• Implement data ingestion, transformation, and integration solutions
Requirements
• Strong experience with Microsoft Azure
• Hands-on experience with PySpark and Apache Spark
• Strong Python programming and SQL skills
• Experience with Azure Data Factory (ADF) and Azure Databricks
• Knowledge of Azure Data Lake Storage Gen2 and Azure Synapse Analytics
• Experience in ETL/ELT, data ingestion, and transformation
• Knowledge of Delta Lake, Parquet, CSV, and JSON formats
• Experience with Git, Azure DevOps, and CI/CD pipelines
• Strong skills in performance tuning, debugging, and data quality