MS Fabric Data Engineer
Karan B.United StatesSENIORPosted 1h ago
MS FabricAzureDataPipelineSQLSparkDBTPythonCI/CDgitFabric lakehouseswarehousesdelta tablesshortcutsSQL analytics endpointsFabric warehouse behaviorEnterprise pipeline engineeringdbt coredbt command-line-interface (CLI)Monitoring and operationAnalytics engineeringSpark performance engineeringAzure devopsgithub actionsfabric CLIREST APIAzure identity and security
About the Role
We are urgently looking for an experienced MS Fabric Data Engineer to join our team in the USA. This is a remote, long-term contract position requiring 12+ years of experience.
Key Responsibilities
• Develop, debug, and maintain Python code in Fabric ingestion pipelines
• Implement automated deployments with PR checks, release gates, isolation, and rollback
• Work with Fabric lakehouses and warehouses, understanding delta tables, shortcuts, SQL analytics endpoints, and Fabric warehouse behavior
• Build automated pipelines with retries, incremental loads, recovery, and transparent failure states
• Implement alerts, centralized logs, pipeline run tracking, and conduct incident investigation
• Perform analytics engineering including reconciliation, deduplication, idempotency, data profiling, and schema contracts
Requirements
• 12+ years of experience in data engineering
• Strong understanding of CI/CD and git-based development
• Experience with Fabric lakehouses + warehouses
• Understanding of delta tables, shortcuts, SQL analytics endpoints, Spark, and Fabric warehouse behavior
• Enterprise pipeline engineering experience
• Python development skills
• dbt core experience with CLI, testing, and CI
• Monitoring and operation experience
• Analytics engineering knowledge
• Insurance industry experience is required
Less critical but still valuable:
• Spark performance engineering
• Experience with Azure devops or github actions
• Experience with fabric CLI or REST API
• Azure identity and security understanding