Jobs → Data & Analytics → Azure Databricks Developer

About the Role We are looking for a hands-on Azure Databricks Developer to design, develop, and optimize scalable, high-throughput data pipelines using Scala Spark, SQL, and Python. Key Responsibilities • Design and develop scalable ETL/ELT pipelines using Azure Databricks, Spark (Scala), and SQL. • Implement Medallion Architecture (Bronze/Silver/Gold) and Delta Lake best practices. • Build real-time and near-real-time data integrations. • Manage workflow scheduling, CI/CD, Git, Azure DevOps, secrets management, and monitoring. • Work with big data technologies such as Hive, Impala, Sqoop, and Spark. • Implement streaming solutions using Spark Streaming and Apache/Confluent Kafka. • Support data integration, data warehousing, and Master Data Management (MDM). • Collaborate with stakeholders to deliver reliable and optimized data solutions. Requirements • Relevant hands-on experience required • Azure Databricks • Scala Spark • Advanced SQL • Python Good-to-Have Skills • Azure and AWS cloud platforms • Data warehousing concepts • Delta Lake and PySpark • GitHub, Jenkins, Jira, and Confluence • Master Data Management solutions • Strong communication and stakeholder management skills