Jobs → Data & Analytics → Databricks Platform Automation Engineer

About the Role We are seeking a highly experienced Databricks Platform Automation Engineer to design, implement, automate, and support enterprise Databricks platform capabilities. This role focuses on building scalable and secure Databricks platform standards and automating various administrative tasks. Key Responsibilities • Design, implement, and administer enterprise Databricks platform environments across development, test, and production • Automate Databricks workspace provisioning, configuration, and lifecycle management using Terraform and Infrastructure as Code • Implement and manage RBAC, IAM, SCIM, service principals, groups, users, and access controls • Administer and maintain Unity Catalog, including catalogs, schemas, external locations, storage credentials, permissions, and data governance policies • Establish and enforce cluster and compute governance, including policies, access controls, cost optimization, and resource standards • Develop automation for user onboarding/offboarding, service principal creation, workspace configuration, and environment setup • Build and maintain CI/CD pipelines for Databricks infrastructure and workload deployments using Azure DevOps or GitHub • Implement and manage Databricks Asset Bundles (DAB) for repeatable and automated deployment of Databricks resources • Support deployment and operationalization of Databricks workflows, jobs, notebooks, data products, and Genie Agents • Develop Python and scripting-based automation to simplify platform administration and operational processes • Integrate Databricks with enterprise cloud, security, identity, networking, and monitoring services • Partner with Cloud Engineering, Security, Data Engineering, DevOps, and Architecture teams to establish secure and scalable platform standards Requirements • 5+ years of experience with Cloud Platform Engineering • 3+ years of hands-on experience with Databricks Platform Administration & Automation • Strong experience with Databricks Administration & Platform Engineering • Proficiency in Terraform / Infrastructure as Code (IaC) • Experience with Unity Catalog & Data Governance • Knowledge of RBAC / IAM / SCIM • Understanding of Service Principals & Identity Management • Experience with Databricks Asset Bundles (DAB) • Familiarity with Genie Agent Deployment & Automation • Experience with CI/CD Pipelines • Proficiency in Git • Experience with Azure DevOps and/or GitHub • Strong scripting skills in Python • Experience with AWS or Azure Cloud • Knowledge of Databricks Workspaces, Jobs, Workflows, Clusters, Compute Policies, and APIs