Jobs → Data & Analytics → Databricks Architect

About the Role We are looking for an experienced Databricks Architect for a high-priority opportunity with a leading client in the Insurance domain. This role involves leading architecture and implementation of enterprise-scale AWS Databricks platforms. Key Responsibilities • Lead architecture and implementation of enterprise-scale AWS Databricks platforms • Design scalable Data Lake, Data Warehouse and Lakehouse solutions • Develop and optimize large-scale data engineering pipelines using Databricks and PySpark • Implement data governance, security, metadata management and quality frameworks • Integrate AWS services with Databricks workflows and DevOps pipelines • Drive AI/GenAI initiatives using Databricks Genie, Agent Bricks and AI/BI capabilities • Lead architecture discussions, technical reviews and end-to-end solution delivery Requirements • 12+ years of experience (15+ preferred) • Strong hands-on experience with Databricks Data Engineering • At least one end-to-end Databricks implementation • Strong expertise in Apache Spark and PySpark • Extensive experience in Data Transformation and Pipeline Development • Strong AWS Cloud Platform experience • Hands-on knowledge of AWS S3, Redshift, Lake Formation and related data services • Enterprise Data Engineering and Lakehouse Architecture • Data Lakes, Data Warehousing and Data Modernization • Strong problem-solving and end-to-end solution delivery capabilities Preferred Skills • 5+ years of Databricks Architecture experience • Databricks Unity Catalog and Delta Lake • Databricks Mosaic AI, Genie and Agent Bricks • AI/ML, GenAI and Advanced Analytics • AWS Solutions Architect Certification • Insurance domain experience • Strong client-facing communication and stakeholder management skills