Data QA Engineer
Santhosh vUnited StatesSENIORPosted 13d ago
Azure DatabricksPythonPySparkSQLCollibraAzure Data FactoryDelta LakeDelta Live TablesUnity CatalogLakehouse architectureData quality testingPower BITableau
About the Role
We are looking for an experienced Data QA professional to work on healthcare applications within an Agile team.
Key Responsibilities
• Design and implement data quality testing, validation, and test automation
• Monitor and maintain Azure Data Factory (ADF) pipelines
• Utilize Azure Databricks, Python, PySpark, and SQL for data analysis
• Collaborate with cross-functional teams for data quality improvements
• Validate reporting layers using Power BI or Tableau
Requirements
• 8+ years of experience in Data QA
• Minimum 3 years of experience in Healthcare Payer domain
• Proficiency in Azure Databricks, Python, PySpark, and SQL
• Experience with Collibra
• Knowledge of Delta Lake, Delta Live Tables, and Unity Catalog
• Understanding of Lakehouse architecture and medallion design patterns
• Strong communication and cross-functional collaboration skills