Azure Databricks Architect
Ganesh VidhaITUnited StatesMIDPosted 54m ago
Azure DatabricksApache SparkPythonScalaSQLDelta LakeAzure Data FactoryAzure Data Lake StorageAzure DevOpsCI/CDData EngineeringData ArchitecturePlatform EngineeringData LakesData HubsAnalytical Data StoresAzure SynapseEvent HubCosmos DB
About the Role
We are looking for an experienced Azure Databricks Architect to lead the design and implementation of scalable, secure, and high-performance data platforms on Microsoft Azure. This is a hands-on architecture role requiring both technical leadership and active development.
Key Responsibilities
• Design and architect end-to-end Azure Databricks-based data platforms
• Build scalable data pipelines using Azure Databricks, Spark, Delta Lake, ADLS, and Azure Data Factory
• Develop reusable ELT frameworks, data models, and best practices
• Optimize Spark workloads for performance, scalability, and cost efficiency
• Establish governance, security, CI/CD, and coding standards
• Collaborate with business, engineering, and architecture teams to deliver enterprise data solutions
• Lead code reviews, production support, and platform modernization initiatives
Requirements
• 12+ years of experience in Data Engineering, Data Architecture, or Platform Engineering
• Strong hands-on experience with Azure Databricks, Apache Spark, Python and/or Scala, SQL, Delta Lake, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS)
• Experience designing enterprise Data Lakes, Data Hubs, and Analytical Data Stores
• Experience with Azure DevOps, CI/CD pipelines, and automated deployments
• Excellent communication and stakeholder management skills