AWS Databricks Architect
Sarath NannapaneniUnited StatesSENIORPosted 1h ago
DatabricksAWSUnity CatalogDelta LakeLakehouse architectureAWS GlueAurora PostgreSQLSparkPySparkDatabricks WorkflowsDeclarative PipelinesAWS S3IAMNetworkingSecurityCI/CDTerraformInfrastructure as CodeData governanceRBACABACCDC architecturesGitHubData ObservabilityData Mesh
About the Role
We are looking for an AWS Databricks Architect with strong enterprise architecture experience and proven expertise in migrating AWS data platforms to Databricks Lakehouse.
Key Responsibilities
• Design and implement enterprise-level Databricks architecture on AWS
• Manage multiple Databricks workspaces
• Lead migrations from AWS Glue and Aurora PostgreSQL to Databricks
• Develop and maintain platform architecture, governance, and security
• Implement CI/CD pipelines using Terraform and Infrastructure as Code
Requirements
• 15+ years of experience in enterprise architecture
• Strong expertise in Unity Catalog, Delta Lake, and Lakehouse architecture
• Experience with AWS Glue to Databricks migration
• Aurora PostgreSQL to Databricks migration experience
• Strong hands-on experience with Spark, PySpark, Databricks Workflows, and Declarative Pipelines
• Expertise in AWS S3, IAM, networking, and security
• Knowledge of enterprise data governance, RBAC/ABAC, and security standards
Benefits
• Long-term contract opportunity
• Competitive hourly rate