Jobs → Data & Analytics → Lead Azure Databricks & Microsoft Fabric Data Architect

About the Role We are looking for a Lead Solution Architect with 10+ years of experience for an immediate, high-impact contract opportunity in Chicago, IL. This role focuses on bridging the gap between heavy-duty engineering in Azure Databricks and modern SaaS deployments in Microsoft Fabric. Key Responsibilities • Design and deliver robust end-to-end data platforms combining Microsoft Fabric and Azure Databricks. • Build real-time streaming and batch pipelines utilizing Fabric Lakehouses, Data Factory, and Databricks Delta Live Tables (DLT). • Optimize Medallion architectures (Bronze, Silver, Gold) using Unity Catalog for unified data security, permissions, and tracking. • Streamline performance using the Delta Lake format, cross-platform shortcutting, and direct semantic integration with Power BI Direct Lake mode. • Actively code in PySpark, guide engineering teams, conduct code reviews, and enforce platform best practices. Requirements • 10+ years of verified data engineering, warehousing, and cloud data architecture experience. • Deep production experience with PySpark, Unity Catalog, Delta Lake, and Delta Live Tables (DLT). • Strong hands-on background within Microsoft Fabric (Lakehouses, Data Factory pipelines, shortcuts). • An automation-first, hands-on leadership style—you must be comfortable diving into code to troubleshoot complex data processing challenges.