SDET ETL Tester
Praveen Kumar ShivakotiUnited StatesMIDPosted 4d ago
ETL testingautomation frameworksscripting languageSQLbig dataInformaticaPySparkAWSS3GlueEMRData CatalogCrawlerSQSETL jobsEventBridgeAthenaRedshift Spectrumtest automationDevOps
About the Role
The SDET (Software Development Engineer in Test) is responsible for ensuring the quality and reliability of ETL processes and data integration workflows. This role involves designing and implementing automated tests to validate data transformation and migration.
Key Responsibilities
• Design and implement automated tests for ETL processes and data integration workflows
• Work with data engineers and developers to identify and resolve data quality issues
• Validate data transformation and migration
• Improve data pipeline performance and integrity
Requirements
• At least 8 years of IT experience, with a minimum of 5 years in ETL testing and automation
• Proficiency in developing automation frameworks and test cases in at least one scripting language
• Strong SQL skills, with experience handling big data using ETL tools (e.g., Informatica)
• Mandatory work experience with PySpark
• Testing experience in the AWS cloud environment, including S3, Glue, EMR, Data Catalog, Crawler, SQS, ETL jobs, EventBridge, Athena and Redshift Spectrum databases
• Experience with AWS commands for running jobs and for file processing and movement
• Experience with test automation and DevOps practices in ETL and cloud systems