SDET
Chandu SUnited StatesMIDPosted 13d ago
pythonpysparksqlawsdatalake house
About the Role
The SDET (Software Development Engineer in Test) is responsible for ensuring the quality and reliability of ETL processes and data integration workflows. This role involves designing and implementing automated tests to validate data transformation and migration, collaborating with data engineers and developers to identify and resolve data quality issues.
Key Responsibilities
• Review requirements, specifications, and technical design documents to provide feedback
• Develop and implement test strategies for complex initiatives
• Estimate, prioritize, plan and coordinate testing activities
• Create automation test framework
• Design, develop and execute automation scripts
• Identify, record, document thoroughly and track bugs
• Perform thorough regression testing when bugs are resolved
• Develop and apply testing processes for new and existing features
Requirements
• At least 8 years of IT experience with minimum 5 years in ETL Testing
• Proficiency in developing automation framework and test cases in scripting languages
• Strong SQL skills with experience in handling big data using ETL tools
• Mandatory work experience with PySpark
• Testing experience in AWS cloud environment (S3, Glue, EMR, Data Catalog, SQS, ETL Jobs, Event Bridge, Athena, Redshift Spectrum)
• Experience with Test Automation and DevOps practices in ETL and Cloud Systems
• Experience with Test Automation and DevOps practices in ETL and Cloud
• Work experience in a Big Data ecosystem processing data in data lakehouse
• Familiarity with DBT (Data Build Tool) or similar data transformation tools
• Experience providing testing oversight in Agile team
• Excellent business communication skills to interact with Business teams and cross-functional teams