Jobs → Data & Analytics → Databricks QA Engineer

About the Role We are looking for an experienced Databricks QA Engineer with a strong Data Engineering background and expertise in modern data quality validation, automation, and AI-assisted QA practices. Key Responsibilities • Develop and execute automated data validation test suites • Validate data ingestion and Medallion architecture workflows • Identify, document, and troubleshoot data quality issues • Implement regression testing and CI/CD quality gates • Collaborate with data engineering and QA teams to ensure production readiness Requirements • Strong hands-on experience with Databricks and Medallion Architecture (Bronze, Silver & Gold) • Expertise in Delta Lake, data ingestion, ELT pipelines, and data validation • Advanced SQL skills for backend and data quality validation • Python, PySpark, and Pytest automation experience • Hands-on experience with Unity Catalog, Lakeflow Pipelines, and Databricks Asset Bundles • Experience with ODCS (Open Data Contract Standard) and contract-based data validation • Knowledge of DQX / Lakeflow Expectations • Azure DevOps CI/CD pipelines and automated quality gates • Automation-first testing approach • AI-assisted testing using LLM agents and MCP • Integration with Azure DevOps and Databricks for automated validation and defect triage • Experience with synthetic/masked test data and PHI-safe practices