Azure Data Engineer
Sai Kiran ChowdaryUnited StatesSENIORPosted 4d ago
Microsoft Azure Data ServicesAzure Data FactoryAzure DatabricksPySparkApache SparkPythonSQLAzure Synapse AnalyticsAzure SQL Data WarehouseETL/ELT Pipeline DevelopmentChange Data CaptureDelta LakeADLS Gen2KafkaData ModelingSCD Type 1SCD Type 2GitHubCI/CDAzure Key VaultData QualityPipeline MonitoringPerformance OptimizationAcceldataPower BITableau
About the Role
We are looking for an experienced senior Azure data engineer to join a data engineering team working on scalable cloud-based data platforms and enterprise data solutions.
Key Responsibilities
• Design and implement scalable cloud-based data platforms
• Develop and maintain enterprise data solutions
• Build and optimize data pipelines and data warehouses
Requirements
• 10+ years of experience in Azure data engineering
• Strong knowledge of Microsoft Azure Data Services
• Proficiency in Azure Data Factory, Azure Databricks, PySpark, and Apache Spark
• Experience with Python, SQL, and Azure Synapse Analytics
• Familiarity with ETL/ELT Pipeline Development and Change Data Capture
• Knowledge of Delta Lake, ADLS Gen2, and Kafka
• Understanding of Data Modeling, SCD Type 1 and Type 2
• Experience with GitHub, CI/CD, and Azure Key Vault
• Skills in Data Quality, Pipeline Monitoring, and Performance Optimization
• Preferred experience with Acceldata, Power BI, or Tableau