ETL Tester with AI Testing Experience
Praveena YadavUnited StatesSENIORPosted 7d ago
ETLSQLAzure DatabricksAgentic AI testingWeb testingTest automation toolsGreat Expectationsdbt testspytestAzure BoardsMLflowLangSmithWeights & Biases
About the Role
We are looking for a Senior QA professional skilled in ETL, SQL, Azure Databricks, Agentic AI evaluation, web testing, and test automation tools to join our team in Chicago, IL. This role focuses on driving data integrity, compliance, and scalable validation strategies.
Key Responsibilities
• Design and implement test strategies for ETL processes
• Perform complex analytical validation queries using SQL
• Validate data using Azure Databricks and PySpark
• Develop test automation frameworks using Python
• Test PHI-scoped healthcare data, including de-identified or synthetic test data
• Manage defects and report in Azure Boards
• Lead team in setting standards and reviewing coverage
Requirements
• 10+ years in data/ETL testing, including strategy ownership on at least one large migration or re-platforming programme
• Proven reconciliation and equivalence testing
• Expert SQL skills for complex analytical validation queries
• Experience with Databricks, PySpark, and Python for test automation
• Data quality and test automation frameworks like Great Expectations, dbt tests, pytest
• Test strategy authorship including coverage models, risk-based prioritisation, entry and exit criteria
• Experience testing across multiple platforms like Databricks, SQL Server, Vertica
• Experience testing LLM or GenAI systems using MLflow, LangSmith, Weights & Biases
• Applied statistics knowledge including sampling design, confidence intervals, significance testing
• Epic EHR data experience
• Knowledge of clinical coding systems: ICD, CPT, SNOMED, LOINC
• Multi-tenant data isolation testing
• Experience testing code- or SQL-generation systems
• Prior work where test evidence was presented directly to client executives
• Understanding of software design principles such as SOLID and Domain-Driven Design