Principal Engineer – Data Platforms
Raghwendra RaoUnited StatesSENIORPosted 1h ago
Microsoft FabricPySparkPythonT-SQLAzure DevOpsGitHub ActionsCI/CDInfrastructure as CodeMicrosoft PurviewUnity CatalogVeevaLIMSELNCTMSERPHRIS
About the Role
We are seeking an experienced Principal Engineer, Data Platforms with strong hands-on expertise in Microsoft Fabric to lead the architecture, development, and delivery of an enterprise-scale data lakehouse platform for a leading BioPharma client. This is a hands-on technical leadership role requiring deep expertise in data engineering, lakehouse architecture, cloud data platforms, and enterprise data governance.
Key Responsibilities
• Lead the architecture and implementation of a Microsoft Fabric-based data lakehouse
• Design and build scalable data ingestion pipelines using Fabric Data Factory, OneLake, and Spark
• Establish medallion architecture (Bronze, Silver, Gold)
• Develop production-grade solutions using PySpark, Python, and T-SQL
• Lead and mentor data engineers through code reviews and architectural guidance
• Implement CI/CD and DevOps practices for data platforms
• Build Power BI semantic models and self-service analytics capabilities
• Establish data governance, security, quality monitoring, and platform SLAs
• Collaborate with business stakeholders and external implementation partners
• Support integrations with enterprise systems such as Veeva, LIMS, ELN, CTMS, ERP, and HRIS
Requirements
• 10+ years of experience in Data Engineering, Data Platforms, or Data Architecture
• 2+ years of technical leadership experience
• Strong hands-on experience with Microsoft Fabric (Lakehouses, Notebooks, Data Factory, Deployment Pipelines)
• Strong proficiency in PySpark, Python, and T-SQL
• Experience with Medallion Architecture (Bronze/Silver/Gold)
• Experience with Azure DevOps, GitHub Actions, CI/CD, and Infrastructure as Code
• Knowledge of Microsoft Purview, Unity Catalog, and Data Governance
• Experience managing external vendors and technical delivery
• Biopharma, Life Sciences, or regulated industry experience is highly preferred