Data Engineer
Sameer BaigUnited StatesMIDPosted 5h ago
SQL ServerFabricPythonPySparkSpark SQLLakehousesBI
About the Role
We are looking for a Data Engineer to re-engineer legacy SQL Server datamarts in Fabric. This role involves working with business experts to understand rules and dependencies and deliver tested migrations.
Key Responsibilities
• Re-engineer legacy SQL Server datamarts in Fabric
• Work with business experts to understand rules and dependencies
• Deliver tested migrations, parallel runs, and controlled cutovers
• Develop reusable Python, PySpark, and Spark SQL transformations in Fabric notebooks and Lakehouses
• Build reliable pipelines with dependencies, retries, monitoring, and safe reruns
• Implement incremental ingestion, change capture, upserts, schema evolution, and backfills
• Build BI-ready dimensional models with clear grain, keys, and history