Azure Databricks Engineer
Eshwar SUnited StatesMIDPosted 2h ago
Azure DatabricksPySparkSpark SQLPythonAzure Data FactoryAzure Data Lake StorageSQLETLELTGitAzure DevOpsCI/CDDelta LakeMedallion architectureData governance
About the Role
We are seeking an experienced Azure Databricks Engineer to design, develop, and optimize scalable data solutions on the Azure cloud platform.
Key Responsibilities
• Design and develop scalable data solutions on Azure
• Optimize data solutions using Azure Databricks
• Develop and maintain ETL/ELT pipelines
• Implement data warehousing solutions
Requirements
• Strong experience with Azure Databricks
• Expertise in PySpark, Spark SQL, and Python
• Experience with Azure Data Factory (ADF)
• Hands-on experience with Azure Data Lake Storage (ADLS Gen2)
• Strong SQL development and query optimization skills
• Experience in ETL/ELT pipeline development
• Understanding of data warehousing concepts and dimensional modeling
• Experience with Git, Azure DevOps, and CI/CD processes
• Knowledge of Delta Lake, medallion architecture, and data governance practices