ETL Tester
Shriyansh SachanUnited StatesSENIORPosted 11d ago
PythonSQLPySparkAzure DatabricksSQL ServerVerticaAzure BoardsMLflowLangSmith
About the Role
We are looking for an experienced ETL Tester with Agentic AI Testing expertise to validate enterprise data pipelines and AI-driven data transformation workflows.
Key Responsibilities
• Lead ETL testing, data migration validation, and source-to-target reconciliation
• Validate SQL queries and transformation logic generated by AI agents
• Test data quality, accuracy, completeness, consistency, and data integrity
• Evaluate AI agents for hallucinations, incorrect joins, missing fields, and unreliable outputs
• Develop automated test suites using Python, SQL, and PySpark
• Work with Azure Databricks, SQL Server, and Vertica
• Track AI evaluation metrics, including precision, recall, confidence calibration, and override rates
• Lead QA activities and collaborate with engineering and business teams
Requirements
• 10+ years of relevant experience in ETL testing / Data QA
• Strong SQL, Python, and PySpark skills
• Hands-on experience with Azure Databricks
• Experience with data migration and source-to-target validation
• Exposure to Agentic AI, LLM evaluation, or AI-generated SQL testing
• Strong test strategy, defect management, and QA leadership skills
• Experience with Azure Boards or similar test management tools
Preferred Qualifications
• Healthcare data experience and familiarity with Epic, Caboodle, or Clarity
• Experience with MLflow, LangSmith, or similar AI evaluation frameworks
• Knowledge of healthcare data standards such as ICD, CPT, SNOMED, or LOINC