Jobs → Data & Analytics → Cloud Data Platform Engineer

About the Role We are seeking a Cloud Data Platform Engineer with extensive experience in AWS and Databricks to join our team. This role involves designing, deploying, and operating AWS infrastructure to support enterprise data platforms. Key Responsibilities • Design, deploy, and operate AWS infrastructure supporting enterprise data platforms, including S3, IAM, networking, databases, and cross-account access • Build and maintain infrastructure using Terraform and related automation tools, ensuring consistent, repeatable deployments across environments • Administer Databricks workspaces and Unity Catalog, including catalogs, schemas, tables, compute, jobs, and service principals • Implement and troubleshoot data access using groups and least-privilege grants; investigate permission inheritance, workspace access, and identity synchronization • Support data platform migrations, including Hive Metastore to Unity Catalog, and validate data access and workloads after migration • Develop and maintain CI/CD pipelines for infrastructure and data platform deployments; troubleshoot failed runs and support safe releases • Support data movement and integration between cloud accounts and platforms, including testing and validating representative data-copy workflows • Monitor platform reliability, security, performance, and cost; troubleshoot incidents and recommend lasting improvements • Support operational requests such as user onboarding, access changes, audit activities, and production changes in accordance with approval and change-management processes • Document architecture, operational procedures, access patterns, and incident resolutions; collaborate with distributed teams across time zones Requirements • Experience operating cloud infrastructure in AWS, including IAM, S3, networking, and cross-account access • Hands-on experience with Terraform or a comparable infrastructure-as-code tool • Experience supporting Databricks, Apache Spark, or a comparable cloud data platform • Understanding of data access controls, identity and group-based permissions, and least-privilege security • Experience with CI/CD, scripting, and production troubleshooting • Strong communication skills and the ability to work with platform users, application teams, security, and operations • Careful approach to production changes, including validation, rollback planning, and change documentation