Databricks Architect
Parasnath SinghUnited StatesSENIORPosted 3h ago
DatabricksSpark SQLPySparkAzurePower BISQL ServerAI/BIGenieDeltaIcebergPythonPostgreSQLMongoDBCassandraHiveCloud platformsEvent-driven architectureMicroservicesData integrationCI/CDAutomated testingDevOpsAgile/Scrum
About the Role
We are seeking a Databricks Architect to join our team in the USA. This role requires extensive experience in software and data architecture, with a focus on modern lakehouse architectures using Databricks.
Key Responsibilities
• Design and implement enterprise data platforms using Databricks and modern lakehouse architectures
• Build agents utilizing Databricks Agentic, AI/BI Dashboard, and Genie Spaces capabilities
• Support AI/ML, predictive analytics, and agentic models
• Lead data modeling, ETL/ELT design, and data warehousing efforts
• Troubleshoot complex system issues and optimize performance across distributed systems
Requirements
• 15+ years in software and data architecture, with 5+ years as a lead or lead architect
• Expertise in Spark SQL, PySpark, Databricks agents, AI/BI, and Genie
• Strong experience with distributed data processing and lakehouse technologies
• Background in healthcare, risk adjustment, or regulated domains
• Hands-on experience with cloud platforms (Azure preferred)
• Strong understanding of event-driven architecture, microservices, and data integration patterns
• Experience with CI/CD pipelines, automated testing, and DevOps practices
• Experience with Agile/Scrum and modern software delivery methodologies
• Strong communication, stakeholder management, and leadership skills