Loading...
Mid LevelFull-timeRustAzureTerraformAgileCI/CDGitAI
Salary Range
$69,360 - $93,840 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are looking for a Data Engineering Manager to join our Microsoft data practice. This role involves designing, building, and operating data pipelines and platform capabilities while supporting junior developers.
Key Responsibilities
- →Design and implement ingestion and transformation pipelines using Azure Data Factory, Synapse pipelines, or Databricks on Azure.
- →Engineer lakehouse or Fabric-native architectures, including medallion patterns, Delta Lake, metadata, and schema governance.
- →Optimize performance, reliability, and cost across storage, compute, and orchestration layers.
- →Implement data quality and observability with expectations, testing, and lineage using tools such as Purview, Fabric data lineage, or equivalent.
- →Build curated models for analytics and AI, and collaborate with BI developers on Power BI or Fabric items.
- →Establish CI/CD for data assets, IaC for platform components, and automate environment provisioning.
- →Mentor and support junior engineers through code reviews, pairing, and structured guidance.
Requirements
- ✓Strong hands-on experience with Azure data services: ADLS Gen2, Data Factory, Synapse, Fabric, Databricks on Azure, Azure SQL, and Cosmos DB.
- ✓Experience in implementing end-to-end solutions with Data Fabric.
- ✓Proficiency in Spark or SQL-based transformations, Delta Lake, performance tuning, and job orchestration.
- ✓Experience with data governance and security: Purview, data classification, access controls, PII handling, and encryption.
- ✓Familiarity with Power BI and semantic modeling, including performance optimization and deployment pipelines.
- ✓CI/CD and IaC for data platforms: Git, Azure DevOps or GitHub, Terraform or Bicep, automated testing for data pipelines.
- ✓Experience mentoring developers and contributing to Agile delivery practices.
- ✓Relevant tertiary qualifications or equivalent experience.
- ✓Microsoft certifications in Fabric Data Engineer or Fabric Analytics Engineer preferred.
- ✓Strong communication and stakeholder engagement skills.
Free to sign up. Takes 30 seconds.
