Platform Engineer
Mahendran Mahesh RUnited StatesSENIORPosted 2h ago
AWSDATABRICKSPLATFORMENGINEERCloud EngineeringDevOpsData InfrastructureUnity CatalogTerraformCI/CDAutomationPythonSQLSecurityIAMS3VPCKMSPrivateLinkGitHub ActionsGitLab CIJenkinsDatabricks APIsDatabricks Asset BundlesCLI tools
About the Role
We are looking for a Platform Engineer to join our team at TechMahindra. This role focuses on administering enterprise Databricks environments and managing cloud infrastructure.
Key Responsibilities
• Administer enterprise Databricks environments including workspaces, compute, SQL warehouses, cluster policies, jobs, and platform security
• Design and implement Unity Catalog including catalogs, schemas, external locations, storage credentials, permissions, and governance controls
• Develop reusable Terraform modules and manage Terraform state, providers, and multi-environment deployment patterns
• Manage AWS infrastructure including IAM, S3, VPC networking, security groups, KMS, and PrivateLink/private connectivity
• Develop automated deployment pipelines using CI/CD tools
• Automate infrastructure using Databricks APIs, Databricks Asset Bundles, CLI tools, and automation frameworks
• Write automation scripts and troubleshoot issues using Python and SQL
Requirements
• 6+ years of experience in Platform Engineering, Cloud Engineering, DevOps, Data Infrastructure, or related engineering roles
• Strong hands-on experience administering enterprise Databricks environments
• Practical experience designing and implementing Unity Catalog
• Advanced experience developing Terraform modules and managing Terraform state
• Strong hands-on experience with AWS services including IAM, S3, VPC, KMS, and PrivateLink
• Experience developing automated deployment pipelines using CI/CD tools
• Experience with Databricks APIs, Databricks Asset Bundles, and CLI tools
• Proficiency in Python and SQL for automation, validation, and troubleshooting
• Strong understanding of cloud security, identity management, least-privilege access, encryption, and secrets management