Azure Databricks Technical Team Lead
Mahesh RoyalUnited StatesSENIORPosted 1h ago
Azure DatabricksApache Sparkdata pipelinesdata lakesPythonScalaSQLAzure Data Lake StorageAzure SQL Databasedata modelingETL processesdata warehousingAzure DevOpsCI/CD processesmachine learning frameworksdata governancecompliance standards
About the Role
We are seeking an experienced Azure Databricks Technical Team Lead with strong expertise in data engineering, Azure Databricks, and technical leadership. The ideal candidate will lead a team of developers and engineers in designing, developing, and implementing scalable, data-driven solutions using Azure Databricks.
Key Responsibilities
• Lead and mentor technical professionals, fostering a collaborative, high-performance team culture.
• Design and implement scalable, efficient data processing solutions using Azure Databricks.
• Collaborate with cross-functional teams to gather requirements and translate them into technical specifications.
• Oversee the complete development lifecycle, from planning and design to deployment and maintenance.
• Conduct code reviews and ensure code quality and adherence to best practices.
• Stay updated on emerging technologies and industry trends in Azure Databricks and data engineering.
• Facilitate communication between technical and non-technical stakeholders.
• Identify and mitigate project delivery risks and team performance challenges.
Requirements
• Strong expertise in Azure Databricks, Apache Spark, data pipelines, and data lakes.
• Proficiency in Python, Scala, or SQL.
• Experience with Azure Data Lake Storage (ADLS) and Azure SQL Database.
• Strong understanding of data modeling, ETL processes, and data warehousing.
• Proven ability to lead technical teams and manage multiple projects simultaneously.
• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Experience in data engineering, software development, or a related technical role.
• Proven track record of leading technical teams and delivering successful projects.
• Azure or data engineering certifications are an added advantage.