Azure Data Engineer
Ritik SinghalCanadaMIDPosted 12d ago
Azure CloudAzure Data EngineeringDatabricksDelta LakeUnity CatalogLakehouse ArchitecturePythonPySparkApache SparkSQLETLELTAzure Data Lake StorageAzure Blob StorageDelta Live TablesLakeflowDatabricks RuntimeTable TriggersDatabricks Asset BundlesGitLabVersion ControlData WarehouseData GovernanceSecuritySpark StreamingReal-Time Data Processing
About the Role
We are looking for an experienced Azure Data Engineer with strong Databricks expertise to build, optimize, and maintain scalable data pipelines and cloud-based data solutions.
Key Responsibilities
• Design, develop, and maintain scalable ETL/ELT pipelines using Databricks
• Process and transform large datasets using PySpark, Spark, and SQL
• Optimize data pipelines for performance, scalability, and cost efficiency
• Implement data governance and access controls using Unity Catalog
• Deploy Databricks jobs, notebooks, and configurations using Databricks Asset Bundles
• Collaborate with business and technical teams to deliver reliable data solutions
Requirements
• Azure Cloud & Azure Data Engineering
• Databricks – Delta Lake, Unity Catalog & Lakehouse Architecture
• Python, PySpark, Apache Spark & SQL
• ETL/ELT Pipeline Development
• Azure Data Lake Storage (ADLS) & Azure Blob Storage
• Delta Live Tables / Lakeflow Declarative Pipelines
• Databricks Runtime & Table Triggers
• Databricks Asset Bundles (DABs)
• GitLab & Version Control
• Data Warehouse, Data Governance & Security
Preferred Certifications
• Azure Data Engineer Associate or Databricks Certified Data Engineer Associate