Databricks Solution Architect
Rajeev kUnited StatesSENIORPosted 6d ago
DatabricksApache SparkPySparkSpark SQLScalaSQLDelta LakeUnity CatalogAWSAzureGCPPythonDockerKubernetesCI/CDMLOpsGenerative AI
About the Role
We are looking for a highly experienced Databricks Solution Architect to lead technical engagements and provide strategic guidance for enterprise data, analytics, and AI initiatives.
Key Responsibilities
• Design and implement enterprise-scale Databricks Lakehouse architectures
• Lead hands-on development using Apache Spark, PySpark, Spark SQL, Scala, and SQL
• Work extensively with Delta Lake, Unity Catalog, Serverless Compute, and Photon
• Optimize large-scale data processing, queries, and cluster performance
• Advise client leadership on data governance, security, MLOps, and operational excellence
• Conduct technical workshops, training, and knowledge-transfer sessions
• Drive adoption of Photon, AI/BI, Mosaic AI, and other advanced Databricks capabilities
• Integrate Databricks securely with AWS, Azure, and GCP
Requirements
• 15+ years of overall IT/data engineering experience
• 5+ years of strong hands-on Databricks experience
• Expert-level Apache Spark / PySpark / Spark SQL / Scala
• Strong AWS/Azure/GCP cloud experience
• Deep knowledge of Databricks Lakehouse, Delta Lake, Unity Catalog, ETL/ELT, and Data Governance
• Strong Python, Scala, SQL, Docker, Kubernetes, and CI/CD experience
• Excellent client-facing, communication, presentation, and consulting skills