Jobs → Data & Analytics → Data Engineer Lead

About the Role We are seeking a Data Engineer/Lead with expertise in Databricks, Azure, and Fabric to design and deliver robust data solutions. This hands-on leader will architect end-to-end data platforms and optimize Medallion architectures. Key Responsibilities • Architect end-to-end data platforms leveraging Microsoft Fabric and Azure Databricks • Design real-time streaming and batch pipelines utilizing Fabric Lakehouses, Data Factory, and Databricks Delta Live Tables • Optimize Medallion architectures using Unity Catalog for unified governance and PySpark for advanced analytics processing • Optimize storage solutions leveraging Delta Lake format, cross-platform shortcutting, and direct integration with Power BI Direct Lake mode • Guide engineering teams, mentoring developers, and ensuring compliance with best practices • Troubleshoot technical challenges and actively code, build pipelines Requirements • 10+ years of experience in data engineering • Deep expertise in Delta Lake, PySpark, and integration with Power BI • Experience with Microsoft Fabric, Azure Databricks, Fabric Lakehouses, Data Factory, and Databricks Delta Live Tables • Strong understanding of optimizing Medallion architectures using Unity Catalog • Hands-on experience with PySpark for advanced analytics processing • Knowledge of Delta Lake format, cross-platform shortcutting, and direct integration with Power BI Direct Lake mode