Principal Engineer – Data Platforms
Harsh SrivastavaUnited StatesSENIORPosted 1h ago
Microsoft FabricPySparkPythonT-SQLAzure DevOpsGitHub ActionsCI/CDInfrastructure as CodeMicrosoft PurviewUnity CatalogPower BIERPVeevaLIMSELNCTMSHRIS
About the Role
We are looking for an experienced Principal Engineer, Data Platforms with strong hands-on expertise in Microsoft Fabric to lead the architecture, development, and delivery of an enterprise-scale data lakehouse platform for a leading BioPharma client. This is a hands-on technical leadership position requiring expertise in data engineering, cloud data platforms, lakehouse architecture, and enterprise data governance.
Key Responsibilities
• Lead the architecture and implementation of a Microsoft Fabric-based data lakehouse
• Design and develop scalable data ingestion pipelines using Microsoft Fabric Data Factory, OneLake, and Spark
• Implement Medallion Architecture (Bronze, Silver, Gold)
• Develop production-grade solutions using PySpark, Python, and T-SQL
• Provide technical leadership, mentorship, and code reviews to data engineering teams
• Implement CI/CD pipelines and DevOps practices for data platforms
• Build Power BI semantic models and self-service analytics solutions
• Establish data governance, data quality monitoring, security, and platform SLAs
• Collaborate with business stakeholders and external implementation partners
• Integrate enterprise systems such as ERP, Veeva, LIMS, ELN, CTMS, and HRIS
Requirements
• 10+ years of experience in Data Engineering, Data Platform Architecture, or Analytics Infrastructure
• 2+ years of technical leadership experience
• Strong hands-on experience with Microsoft Fabric (Lakehouses, Notebooks, Data Factory, Deployment Pipelines)
• Strong proficiency in PySpark, Python, and T-SQL
• Experience with Medallion Architecture (Bronze/Silver/Gold)
• Experience with Azure DevOps, GitHub Actions, CI/CD, and Infrastructure as Code
• Knowledge of Microsoft Purview, Unity Catalog, and Data Governance
• Experience managing external vendors and technical delivery
• Biopharma, Life Sciences, or regulated industry experience strongly preferred