Azure Databricks Developer
Nas AliUnited KingdomMIDPosted 6d ago
Azure DatabricksApache SparkPySparkSpark SQLDelta LakeAzure Data LakeStorage Gen2Azure Data FactoryMicrosoft FabricData FactoryGit version controlSQL developmentPython programmingMicrosoft FabricAzure Synapse AnalyticsAzure Event HubsKafkaPower BIDatabricks WorkflowsAzure DevOpsTerraformUnity CatalogMLflowAzure Machine Learning
About the Role
We are seeking an Azure Databricks Developer for a 6 months+ contract position. This role requires working with enterprise-scale data pipelines and distributed processing technologies within Azure environments.
Key Responsibilities
• Develop enterprise-scale data pipelines
• Work with large data volumes and distributed processing technologies
• Build ETL/ELT solutions within Azure environments
• Implement data quality and monitoring controls
• Work within Agile delivery teams
Requirements
• Experience in Azure Databricks
• Proficiency in Apache Spark, PySpark, and Spark SQL
• Knowledge of Delta Lake, Azure Data Lake Storage Gen2
• Experience with Azure Data Factory or Microsoft Fabric
• Git version control and SQL development skills
• Python programming experience
Desirable Skills
• Microsoft Fabric, Azure Synapse Analytics
• Azure Event Hubs, Kafka
• Power BI, Databricks Workflows
• Azure DevOps, Terraform
• Unity Catalog, MLflow
• Azure Machine Learning