Databricks Solution Architect
Renukaa DeshpandeRemoteSENIORPosted 1h ago
DatabricksApache SparkPySparkDelta LakeUnity CatalogData engineeringBig dataCloud platformsPerformance optimizationLakehouse architecture
About the Role
We are looking for an experienced Databricks Solution Architect to design, develop, optimize, and support scalable data engineering and analytics solutions. The ideal candidate will bring deep expertise in Databricks and distributed data platforms, drive architecture decisions, troubleshoot complex challenges, and deliver high-quality Lakehouse implementations.
Key Responsibilities
• Design and implement scalable Databricks Lakehouse solutions
• Translate technical and business requirements into robust data platform architectures
• Lead end-to-end Databricks project implementations and provide implementation guidance
• Drive architecture discussions and recommend effective data engineering approaches
• Develop and optimize data pipelines using Apache Spark and PySpark
• Troubleshoot complex Databricks and Spark issues across development and production environments
• Apply performance optimization techniques for distributed data processing workloads
• Support production deployments and ensure reliable, scalable data solutions
• Collaborate with stakeholders on data engineering, analytics, and platform initiatives
Requirements
• Databricks
• Apache Spark
• PySpark
• Delta Lake
• Unity Catalog
• Data engineering and data platform architecture
• Big data and distributed computing
• Cloud platforms
• Performance optimization
• Lakehouse architecture
• End-to-end Databricks implementation experience
• Strong consulting, communication, and stakeholder management skills