Databricks Architect
Shivam KatiyarUnited StatesSENIORPosted 4d ago
DatabricksAWSUnity CatalogDelta LakeAWS GlueAurora PostgreSQLSQL WarehousesCI/CDInfrastructure as CodeAWS S3IAMSparkPySparkDeclarative PipelinesRBACABACTerraformGitHubCDCData mesh
About the Role
We are looking for a Senior/Lead Databricks Architect with strong enterprise-level experience implementing Databricks on AWS and leading complex data platform migrations in large, regulated environments.
Key Responsibilities
• Design and implement enterprise Databricks architecture on AWS
• Manage multiple Databricks workspaces
• Implement platform governance, security standards, and data governance
• Lead migration from AWS Glue and Aurora PostgreSQL to Databricks Lakehouse
• Develop Databricks Workflows, Spark, PySpark, and Declarative Pipelines
• Implement SQL Warehouses, CI/CD, and Infrastructure as Code
• Configure AWS S3, IAM, networking, and security controls
• Create reusable architecture patterns and platform accelerators
Requirements
• Hands-on expertise in Databricks architecture and platform governance
• Experience with AWS Glue to Databricks migration
• Experience with Aurora PostgreSQL and AWS data lake migration to Databricks
• Strong understanding of Unity Catalog, Delta Lake, and enterprise data governance
• Experience with Databricks Workflows, Spark, PySpark, and Declarative Pipelines
• Knowledge of SQL Warehouses, CI/CD, and Infrastructure as Code
• Experience with AWS S3, IAM, networking, and security controls
• Experience with reusable architecture patterns and platform accelerators