Big Data / ETL QA Test Engineer
Samatha MandadiUnited StatesMIDPosted 12d ago
Big Data testingETL testingdata validationAPI testingKafkaPythonApache SparkHive Query LanguageSQLAgentic AI testing
About the Role
We are looking for an experienced Big Data / ETL QA Test Engineer to join our team. This role requires strong expertise in data validation, ETL testing, and Big Data technologies.
Key Responsibilities
• Perform Big Data testing and end-to-end data flow validation
• Conduct ETL testing, source-to-target validation, and data quality checks
• Execute API testing including request/response, payload, and integration testing
• Work with Kafka messaging, producers, consumers, and event validation
• Develop test automation and data validation using Python
• Test Apache Spark for data processing
• Write and execute complex SQL queries using Hive Query Language
• Test Agentic AI workflows, tool interactions, and end-to-end scenarios
• Maintain strong understanding of Big Data architecture and data pipelines
Requirements
• Experience in Big Data testing and end-to-end data flow validation
• Proficiency in ETL testing, source-to-target validation, and data quality checks
• Strong API testing skills including request/response, payload, and integration testing
• Knowledge of Kafka messaging, producers, consumers, and event validation
• Experience with Python for test automation and data validation
• Familiarity with Apache Spark testing and data processing
• Proficiency in Hive Query Language and complex SQL queries
• Understanding of Agentic AI testing, including workflows, tool interactions, and end-to-end scenarios
• Strong understanding of Big Data architecture and data pipelines