Data QA Engineer
Santosh Kumar KalamsettyUnited StatesMIDPosted 13d ago
Azure DatabricksPythonPySparkSQLCollibraHealthcare Payer DomainAzure Data FactoryLakehouse ArchitectureMedallion Design Patterns
About the Role
We are looking for an experienced Data QA Engineer to join an Agile team focused on building and enhancing healthcare applications in the Payer domain.
Key Responsibilities
• Perform end-to-end data quality assurance and testing for healthcare applications and data pipelines
• Validate data processing and transformations using Azure Databricks, Delta Lake, Delta Live Tables (DLT), and Unity Catalog
• Develop and execute automated data validation and testing frameworks using Python, PySpark, and SQL
• Test Azure Data Factory pipelines, including execution monitoring, error handling, and CI/CD processes
• Validate data across Bronze, Silver, and Gold layers within Lakehouse and Medallion architectures
• Ensure data accuracy, completeness, consistency, and integrity across healthcare payer datasets
• Validate reporting-layer data using Power BI and Tableau
• Support data governance and metadata management initiatives using Collibra
• Collaborate with developers, business analysts, and cross-functional teams in an Agile environment
Requirements
• 8+ years of experience in Data QA / Data Testing, including at least 3 years in the Healthcare Payer Domain
• Strong analytical, troubleshooting, communication, and leadership skills
• Experience validating enterprise-scale data pipelines and reporting solutions