Microsoft Fabric Data Engineer
Vishal D.United StatesSENIORPosted 1h ago
Microsoft FabricCI/CDgitAutomated deploymentsFabric lakehousesFabric warehousesDelta tablesSQL analytics endpointsSparkEnterprise pipeline engineeringAutomated pipelinesPythondbt coredbt CLIMonitoringAnalytics engineeringInsuranceSpark performance engineeringAzure devopsgithub actionsFabric CLIREST APIAzure identityAzure security
About the Role
We are looking for experienced Microsoft Fabric Data Engineers for contract-to-hire positions. This role requires expertise in data engineering with Microsoft Fabric and related technologies.
Key Responsibilities
• Develop and maintain data pipelines using Microsoft Fabric
• Implement CI/CD processes and automated deployments
• Work with Fabric lakehouses and warehouses
• Utilize delta tables, shortcuts, SQL analytics endpoints, and Spark
• Build enterprise-grade pipeline engineering solutions
• Develop Python code for ingestion pipelines and dbt deployment pipelines
• Implement monitoring and operational solutions
• Perform analytics engineering tasks
Requirements
• 12+ years of experience in data engineering
• Strong knowledge of Microsoft Fabric
• Experience with CI/CD and git-based development
• Ability to build automated deployments with PR checks, release gates, isolation, and rollback
• Proficiency with Fabric lakehouses and warehouses
• Understanding of delta tables, shortcuts, SQL analytics endpoints, Spark, and Fabric warehouse behavior
• Experience with enterprise pipeline engineering
• Ability to build automated pipelines with retries, incremental loads, recovery, and transparent failure states
• Strong Python programming skills
• Experience with dbt core and CLI
• Project work with dbt including testing and CI
• Experience with monitoring and operation
• Ability to implement alerts, centralized logs, and pipeline run tracking
• Experience with incident investigation
• Strong analytics engineering skills
• Insurance domain experience is required
• Experience with Spark performance engineering is valuable
• Experience with Azure devops or github actions is valuable
• Experience with the fabric CLI or REST API is valuable
• Understanding of Azure identity and security is valuable