Databricks Engineer
Safiya ShaikUnited StatesSENIORPosted 2h ago
DatabricksPythonPySparkSQLAzure Data EngineeringAzure Data FactoryADLS Gen2Delta LakeUnity CatalogETL/ELTbatch and streaming datamedallion architectureCI/CDAzure DevOpsGitHub Actions
About the Role
We are looking for a Databricks Engineer to join our team. This role requires extensive experience in data engineering and hands-on Databricks expertise.
Key Responsibilities
• Design and implement data solutions using Databricks
• Develop and maintain ETL/ELT pipelines
• Work with batch and streaming data
• Implement medallion architecture
• Utilize Azure Data Factory, ADLS Gen2, Delta Lake, and Unity Catalog
• Apply CI/CD practices using Azure DevOps or GitHub Actions
Requirements
• 10+ years of experience in Data Engineering / Data Warehousing
• 5+ years of hands-on Databricks experience
• Strong Python, PySpark, and SQL skills
• 3+ years of Azure Data Engineering experience
• Expertise in Azure Data Factory, ADLS Gen2, Delta Lake, and Unity Catalog
• Experience with ETL/ELT pipelines, batch and streaming data, and medallion architecture
• Knowledge of CI/CD using Azure DevOps or GitHub Actions
• Strong technical leadership and mentoring skills
• Preferred: Databricks Data Engineer Professional Certification