Loading...
Data Quality Engineer, Enterprise Data Platform - Data Quality & Data governance) , AWS , SQL & Python , Cloud, Power BI at WesternDigital
WesternDigitalBengaluru, KA, in·9h ago
SeniorFull-timeRustAWSAIML
Salary Range
$26,520 - $35,880 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are seeking a skilled Data Quality Engineer to advance the data trust, governance, and certification framework for our enterprise Data Lakehouse platform built on Databricks, Apache Iceberg, AWS, Dremio, Atlan, and Power BI. This role is critical in ensuring that data across Bronze, Silver, and Gold layers is certified, discoverable, and AI/BI-ready.
Key Responsibilities
- →Build and maintain automated validation frameworks across Bronze → Silver → Gold pipelines
- →Develop tests for schema drift, anomalies, reconciliation, timeliness, and referential integrity
- →Integrate validation into Databricks and Iceberg-based pipelines
- →Define data certification workflows ensuring only trusted data is promoted for BI/AI consumption
- →Leverage Atlan and AWS Glue Catalog for metadata management, lineage, glossary, and access control
- →Build a governed semantic layer on gold data to support BI and AI-driven consumption
- →Prepare and certify datasets that fuel conversational analytics experiences
- →Provide certified, feature-ready datasets for ML training and inference in SageMaker Studio
Requirements
- ✓Experience with Databricks, Apache Iceberg, and AWS services
- ✓Knowledge of data quality frameworks and metrics
- ✓Strong understanding of data governance principles
- ✓Experience with semantic layer development
- ✓Familiarity with Power BI and BI tools
- ✓Understanding of ML data requirements
- ✓Ability to enforce all 9 dimensions of data quality
Free to sign up. Takes 30 seconds.
