Databricks Architect
sunny KumarUnited StatesMIDPosted 27m ago
DatabricksDelta LakePySparkSpark SQLDelta Live TablesAuto LoaderStructured StreamingUnity CatalogTerraformAzure DevOpsGitHub ActionsCI/CDMedallion ArchitectureAgentic AILangChainLangGraphRAGLLM integrationVector Search
About the Role
We are looking for an experienced Databricks Architect with strong hands-on expertise in Databricks Genie AI / Genie Agents to lead enterprise Lakehouse architecture, AI modernization, and scalable data platform implementations across Azure and AWS environments.
Key Responsibilities
• Lead enterprise Lakehouse architecture
• Implement AI modernization
• Develop scalable data platform implementations
• Work with Azure and AWS environments
• Implement Databricks Genie AI / Genie Agents for natural-language analytics
• Utilize Agentic AI, LangChain, LangGraph, RAG, LLM integration and Vector Search
• Work with PySpark, Spark SQL, Delta Live Tables, Auto Loader and Structured Streaming
• Manage Unity Catalog, data governance, data security and data lineage
• Experience with Azure Databricks / AWS Databricks and cloud data services
• Implement Terraform, Azure DevOps, GitHub Actions and CI/CD pipelines
• Apply Medallion Architecture, Delta Lake and data modeling
Requirements
• 10+ years of experience in Data Architecture / Data Engineering
• 5–6+ years of hands-on experience with Databricks and Delta Lake
• Strong hands-on experience implementing Databricks Genie AI / Genie Agents
• Experience with Agentic AI, LangChain, LangGraph, RAG, LLM integration and Vector Search
• Expertise in PySpark, Spark SQL, Delta Live Tables, Auto Loader and Structured Streaming
• Strong knowledge of Unity Catalog, data governance, data security and data lineage
• Experience with Azure Databricks / AWS Databricks and cloud data services
• Hands-on experience with Terraform, Azure DevOps, GitHub Actions and CI/CD pipelines
• Knowledge of Medallion Architecture, Delta Lake and data modeling
• Strong technical leadership, solution architecture and stakeholder collaboration skills
Preferred Certifications
• Databricks Certified Data Engineer Professional
• Databricks Certified Machine Learning Professional
• Azure / AWS Cloud Certifications
Must-Have: Direct hands-on experience with Databricks Genie AI / Genie Agents is mandatory.