Jobs → Data & Analytics → Databricks Data Engineer

About the Role We are seeking a highly skilled Databricks Data Engineer to support the Retail Spine initiative, working with a wide range of retail datasets to design, build, and optimize scalable data solutions. Key Responsibilities • Design, build, and optimize scalable data solutions for retail datasets • Develop new data pipelines while enhancing existing data workflows • Contribute to end-to-end data engineering pipelines with CDC capabilities • Thrive in a fast-paced Azure-based environment leveraging Databricks, PySpark, and Kafka streaming Requirements • Extensive hands-on experience with Databricks • Proven experience building end-to-end data engineering pipelines with CDC capabilities • Strong proficiency in PySpark and SQL • Experience working in Microsoft Azure cloud environments • Knowledge of Delta Lake, distributed data processing frameworks, and streaming technologies (Kafka) • Understanding of data modeling (SCD Type 1 & Type 2) • Experience integrating data from multiple structured and unstructured data sources • Familiarity with GitHub and CI/CD pipelines for version control and deployment • Strong understanding of data architecture, performance optimization, and pipeline scalability