Microsoft Fabric Data Lake Developer
Sakshi PendharkarUnited StatesMIDPosted 1h ago
Microsoft FabricOneLakeDelta tablesSQLPythonPySparkFabric Data FactoryDataflows Gen2Spark SQLmedallion architectureData ingestionData transformationData integrationIncremental loadingChange data captureData validationData qualityData governancePipeline monitoringPerformance optimizationPower BI
About the Role
We are looking for an experienced Microsoft Fabric Data Lake Developer to design scalable lakehouse solutions and build robust data pipelines. This role focuses on creating reliable, governed data platforms and curated datasets for analytics and reporting.
Key Responsibilities
• Design and develop lakehouse solutions using Microsoft Fabric, OneLake, and Delta tables
• Build and maintain data ingestion and transformation pipelines using Fabric Data Factory, Dataflows Gen2, and notebooks
• Integrate data from databases, APIs, enterprise applications, and file-based sources
• Implement Bronze, Silver, and Gold data layers using medallion architecture
• Develop transformations using SQL, Python, PySpark, and Spark SQL
• Implement incremental loading, change data capture, and data validation processes
• Monitor pipelines, troubleshoot failures, and optimize performance and resource usage
• Apply data security, access controls, governance, and data quality standards
• Prepare curated datasets for Power BI reporting and downstream analytics
• Collaborate with architects, business analysts, and reporting teams to translate requirements into technical solutions
• Maintain technical documentation, source-to-target mappings, and operational support procedures
• Support version control, testing, and deployment across development, test, and production environments
Requirements
• Microsoft Fabric
• OneLake and lakehouse architecture
• SQL and Spark SQL
• Python and PySpark
• Fabric Data Factory and Dataflows Gen2
• Delta tables and medallion architecture
• Data ingestion, transformation, and integration
• Incremental loading and change data capture
• Data validation, quality, governance, and access controls
• Pipeline monitoring, troubleshooting, and performance optimization
• Experience preparing datasets for Power BI and downstream analytics