AWS Databricks Platform Administrator
Himanshu VermaUnited StatesMIDPosted 10d ago
Databricks AdministrationUnity CatalogDelta LakeAWSS3IAMVPCKMSCloudWatchCloudTrailTerraformPython ScriptingCI/CD AutomationCloud SecurityGovernanceProduction SupportIncident ManagementSparkData LakehouseDistributed data workloads
About the Role
We are looking for an experienced AWS Databricks Platform Administrator to join our team. This role involves managing, securing, optimizing, and supporting an enterprise-scale Databricks platform that powers critical data and analytics initiatives.
Key Responsibilities
• Administer and support Databricks workspaces, clusters, SQL Warehouses, Unity Catalog, jobs, repositories, and access controls
• Manage AWS services including S3, IAM, VPC, KMS, CloudWatch, CloudTrail, PrivateLink, and Secrets Manager
• Implement platform security, governance, RBAC, SSO, and compliance controls
• Monitor platform performance, reliability, and capacity while resolving production issues
• Drive cloud cost optimization (FinOps) and resource efficiency
• Automate deployments and platform management using Terraform, Python, Databricks CLI/SDK, and CI/CD pipelines
• Lead upgrades, migrations, disaster recovery testing, and operational excellence initiatives
Requirements
• 9+ years of IT experience in Cloud Infrastructure, Platform Engineering, DevOps, or Data Platforms
• 5+ years of hands-on Databricks Administration experience
• Strong expertise with Databricks Administration, Unity Catalog, Delta Lake, AWS (S3, IAM, VPC, KMS, CloudWatch, CloudTrail), Terraform, Python Scripting, CI/CD Automation, Cloud Security & Governance, Production Support & Incident Management
• Solid understanding of Spark, Data Lakehouse architecture, and distributed data workloads