Databricks Architect
Domain Experts GroupUnited StatesMIDPosted 8h ago
Data EngineeringData PlatformsData AnalyticsModern Data WarehouseDatabricksCloud-native data platformsAWSAzureGCPApache SparkDelta LakeStructured StreamingDevOpsCI/CDAzure DevOpsGitHub ActionsGitLab CI/CDJenkinsMLOpsMachine learningDelta Live TablesUnity CatalogMLflow
About the Role
We are looking for a Databricks Architect to join our team. This role focuses on designing and implementing scalable data solutions using Databricks and cloud platforms.
Key Responsibilities
• Design and implement cloud-native data platforms across AWS, Azure, and/or GCP
• Lead end-to-end Databricks implementations as a hands-on developer, technical lead, or solution architect
• Develop scalable ETL/ELT pipelines using Databricks, Delta Lake, and Structured Streaming
• Implement DevOps and CI/CD practices for production-grade data solutions
• Troubleshoot complex data platform challenges and recommend architecture patterns
Requirements
• 12-15+ years of experience in Data Engineering, Data Platforms, Data Analytics, and Modern Data Warehouse solutions
• 10+ years of overall consulting and client-facing delivery experience
• Demonstrated success delivering 6-8+ end-to-end Databricks implementations
• Databricks Data Engineering Professional certification (or equivalent advanced Databricks certification)
• Strong expertise in designing and implementing cloud-native data platforms
• Advanced knowledge of Apache Spark, including performance optimization and Spark runtime internals
• Extensive hands-on experience with Databricks, Delta Lake, Structured Streaming, and modern data engineering frameworks
• Experience implementing DevOps and CI/CD practices using tools such as Azure DevOps, GitHub Actions, GitLab CI/CD, or Jenkins
• Working knowledge of MLOps principles, machine learning lifecycle management, and model deployment
• Current and broad understanding of the Databricks Lakehouse Platform, including Delta Lake, Unity Catalog, Workflows, MLflow, and Delta Live Tables
• Strong experience tuning large-scale distributed workloads and designing highly performant, scalable, and cost-efficient data processing solutions
Benefits
• Opportunity to work on multiple open roles
• Experience working in public sector, banking, and healthcare is welcome