Databricks Administrator
SRIRAJ KUMAR SATHUPATISENIORPosted 11d ago
DatabricksAWSAzureGoogle CloudUnity CatalogIdentity and Access ManagementGovernanceMonitoringAutomationTerraformAzure Data FactoryAWS GlueMicrosoft Entra IDAWS IAMApache SparkPySparkDelta LakeData EngineeringCloud ComputingData GovernanceDevOpsCloud SecurityData LakehousePlatform Engineering
About the Role
We are seeking an experienced Databricks Administrator to manage, secure, optimize, and support enterprise Databricks environments across cloud platforms.
Key Responsibilities
• Administer Databricks workspaces across AWS, Azure, or Google Cloud
• Manage clusters, compute policies, jobs, workflows, SQL warehouses, and workspace configurations
• Configure Unity Catalog, catalogs, schemas, tables, permissions, and data governance policies
• Manage users, groups, service principals, SSO, SCIM provisioning, and role-based access controls
• Implement secure data access, secrets management, encryption, and compliance controls
• Monitor platform usage, job failures, performance, costs, and resource utilization
• Troubleshoot cluster startup issues, job failures, connectivity, and performance bottlenecks
• Manage notebooks, libraries, runtime versions, repositories, and environment configurations
• Support Delta Lake, Lakehouse architecture, and data engineering workloads
• Automate administrative tasks using APIs, CLI tools, Terraform, and scripting
• Implement workspace provisioning, configuration management, and infrastructure automation
• Support CI/CD, Git integration, deployment workflows, and environment promotion
• Establish platform standards, operational documentation, backup strategies, and recovery procedures
• Collaborate with data engineers, architects, security teams, and cloud infrastructure teams
• Support incident management, root-cause analysis, upgrades, and platform maintenance
Requirements
• 12+ years of experience in Databricks administration
• Strong experience in workspace administration, cluster and compute management
• Knowledge of Unity Catalog, identity and access management, governance, and monitoring
• Experience with cloud platforms (AWS, Azure, Google Cloud)
• Familiarity with automation tools and scripting
• Experience with data engineering and lakehouse architecture
Preferred Qualifications
• Experience with Azure Data Factory, AWS Glue, or cloud-native orchestration tools
• Knowledge of Microsoft Entra ID, AWS IAM, or equivalent cloud identity services
• Experience with network security, private connectivity, and enterprise cloud governance
• Familiarity with Terraform, Azure DevOps, GitHub Actions, or Jenkins
• Experience supporting large-scale enterprise data platforms and production workloads
• Relevant Databricks or cloud certifications