Lead Databricks Platform Administrator
Murali Krishna KollaUnited StatesLEADPosted 31m ago
DatabricksTerraformInfrastructure as Code (IaC)CI/CDGitHubDevOpsUnity CatalogDatabricks APIsPythonSQLSpark
About the Role
We are seeking a Lead Databricks Platform Administrator to join our team. This role involves leading platform implementation, configuration, administration, and ongoing support, as well as providing technical leadership to a team of engineers.
Key Responsibilities
• Lead Databricks platform implementation, configuration, administration, and ongoing support
• Develop, maintain, and troubleshoot Terraform infrastructure and deployment configurations
• Independently diagnose and resolve complex Databricks and Terraform issues
• Provide technical leadership and direction to 3–4 engineers within a scrum team
• Refine features and user stories, delegate work, and ensure successful delivery
• Serve as the first escalation point for technical issues
• Research new Databricks capabilities and determine how to implement them within the enterprise environment
• Manage Databricks access, security, permissions, service principals, and Unity Catalog
• Support CI/CD pipelines, GitHub, platform automation, and DevOps practices
• Work with internal engineering, ML/AI, security, and infrastructure teams
• Make independent technical decisions aligned with the platform roadmap
• Escalate architectural, enterprise security, or major infrastructure changes to leadership when appropriate
Requirements
• 6+ years of relevant platform engineering, administration, or infrastructure experience
• Advanced Databricks Platform Engineering & Administration: Extensive hands-on experience implementing, administering, troubleshooting, and supporting Databricks in an enterprise environment
• Advanced Terraform / Infrastructure as Code (IaC): Deep hands-on Terraform experience provisioning, configuring, automating, and troubleshooting Databricks infrastructure
• Prior technical lead or manager experience
• GitHub source control experience
• CI/CD and infrastructure automation experience
• Knowledge of Unity Catalog, Databricks APIs, access management, and platform governance
• Working knowledge of Python, SQL, and Spark
• Ability to independently solve complex technical issues and guide experienced engineers