Databricks Architect
Shaik SafreenUnited StatesSENIORPosted 7d ago
Databricks Lakehouse ArchitectureAWS (S3, Glue Catalog, IAM, Lambda, Kinesis)PySparkSpark SQLDelta LakeMedallion ArchitectureDelta Live PipelinesStructured StreamingUnity CatalogData GovernanceSecurityCI/CDGitHubGitLabTerraformPerformance OptimizationPartitioningCachingZORDERFile CompactionLow-Latency Data DeliveryScalable Data Platforms
About the Role
We are looking for an experienced Databricks Architect to join our team. This role focuses on designing and implementing Databricks Lakehouse solutions on AWS, working with large-scale data platforms and modern analytics architectures.
Key Responsibilities
• Design and implement Databricks Lakehouse solutions on AWS
• Work with multi-terabyte datasets and modern analytics architectures
• Lead architecture discussions and mentor engineering teams
Requirements
• 15+ Years of Data Engineering / Data Architecture Experience
• 3+ Years of Hands-on Databricks Experience
• Strong AWS Cloud and Distributed Data Processing Expertise
• Experience with PySpark, Spark SQL, Delta Lake
• Knowledge of Medallion Architecture, Delta Live Pipelines, and Structured Streaming
• Familiarity with Unity Catalog, Data Governance, and Security
• Experience with CI/CD, GitHub/GitLab, and Terraform
• Skills in Performance Optimization, Partitioning, Caching, ZORDER, and File Compaction
• Ability to deliver low-latency data and build scalable data platforms