Azure Databricks Platform Engineering Lead
Amrinder SinghUnited StatesLEADPosted 2h ago
Azure DatabricksUnity CatalogData GovernanceDelta LakeLakehouse ArchitectureApache SparkPySparkPythonSQLTerraformInfrastructure as CodeAzure DevOpsCI/CDCluster ManagementAzure NetworkingSecurityKey VaultADLS Gen2Azure Data Factory
About the Role
We are looking for an experienced Azure Databricks Platform Engineering Lead to drive enterprise platform administration, governance, automation, and technical delivery.
Key Responsibilities
• Drive enterprise platform administration, governance, automation, and technical delivery
• Provide hands-on technical leadership for Databricks platform administration
• Implement infrastructure automation and governance
• Provide production support for the platform
Requirements
• 14–15 years of experience
• Expertise in Azure Databricks & Account Administration
• Experience with Unity Catalog & Data Governance
• Knowledge of Delta Lake / Lakehouse Architecture
• Proficiency in Apache Spark / PySpark / Python / SQL
• Experience with Terraform / Infrastructure as Code (IaC)
• Familiarity with Azure DevOps / CI/CD
• Skills in Cluster Management & Optimization
• Understanding of Azure Networking / Security / Key Vault
• Experience with ADLS Gen2 / Azure Data Factory