Jobs → Data & Analytics → Big Data Test Manager

About the Role We are seeking an experienced Big Data Test Manager to lead quality engineering and testing initiatives for enterprise-scale data platforms, Big Data applications, ETL/ELT pipelines, and cloud-based data solutions. Key Responsibilities • Lead end-to-end testing activities across Big Data, data engineering, ETL/ELT, data warehouse, and cloud data platforms • Manage testing for Databricks, Azure Data Factory (ADF), Spark/PySpark, Hadoop, Hive, Delta Lake, and enterprise data pipelines • Establish standards for data validation, source-to-target testing, reconciliation, data quality, and end-to-end testing • Oversee functional, integration, system, regression, performance, UAT, and production validation testing • Promote BDD, Gherkin, TDD, shift-left testing, and automation practices • Lead defect triage, root-cause analysis, risk assessment, and resolution activities Requirements • 10+ years of overall QA/testing experience • Significant experience leading Big Data, ETL, Data Warehouse, Data Engineering, or cloud data testing initiatives • Demonstrated experience managing distributed testing teams • Experience working directly with business and technology stakeholders in an enterprise Agile environment • Strong understanding of Databricks, Azure Data Factory (ADF), Apache Spark, PySpark, Hadoop, HDFS, Hive, SQL, ETL/ELT, data lakes, Delta Lake, and data warehousing • Strong experience with data validation, reconciliation, data quality, complex SQL testing, and large-volume data testing • Experience with Selenium, Cucumber, Gherkin, Postman, REST Assured, JMeter, PyTest, JUnit/TestNG, or equivalent frameworks • Experience with JIRA, Azure DevOps, HP ALM/Quality Center, or similar test and defect management tools • Experience implementing BDD, Gherkin-based acceptance testing, TDD, unit testing, automated integration testing, regression automation, and continuous testing practices • Experience integrating automated testing with Azure DevOps, Jenkins, GitHub Actions, or similar CI/CD platforms