Data QA Engineer
Kaveri PUnited StatesSENIORPosted 13d ago
Azure DatabricksPythonPySparkSQLAzure Data FactoryCollibraHealthcare Payer DomainLakehouse ArchitectureMedallion Design PatternsData Test AutomationPower BITableau
About the Role
We are looking for an experienced Data QA Engineer with strong expertise in Azure Databricks, data quality testing, and healthcare payer data to join our Agile team.
Key Responsibilities
• Design and implement data quality testing frameworks
• Automate data validation processes
• Collaborate with cross-functional teams on healthcare payer projects
• Ensure data integrity and accuracy
• Monitor and maintain data governance standards
Requirements
• 8+ years of experience in Data QA
• Strong expertise in Azure Databricks, including Workflows, Delta Lake, Delta Live Tables, and Unity Catalog
• Proficiency in Python, PySpark, and SQL
• Experience with Azure Data Factory (ADF) – Pipelines, Monitoring, and CI/CD
• Healthcare Payer Domain Experience (3+ Years)
• Knowledge of Lakehouse Architecture and Medallion Design Patterns
• Experience with Data Test Automation and Validation
• Familiarity with Power BI and Tableau for reporting data validation
• Bachelor's or Master's degree in Engineering or Science