ETL/AWS Software Engineer
Shubham RaoUnited StatesMIDPosted 8h ago
DataStageInformaticaAWS GlueAWS LambdaAWS S3AWS EC2AWS Step FunctionsPythonPySparkPerlShell ScriptingSQLDB2RedshiftAurora PostgreSQLAirflow DAGsREST APIsSOAP APIsJenkinsGitCI/CDData MigrationData WarehousingData Validation
About the Role
We are looking for an experienced ETL/AWS Software Engineer to join our team. This role focuses on developing and supporting ETL processes in AWS environment.
Key Responsibilities
• Develop ETL processes using DataStage or Informatica
• Implement AWS services including Glue, Lambda, S3, EC2, and Step Functions
• Write Python, PySpark, Perl, and Shell scripts for data processing
• Work with SQL databases including DB2, Redshift, and Aurora PostgreSQL
• Create and manage Airflow DAGs
• Develop and integrate REST/SOAP APIs
• Implement CI/CD pipelines using Jenkins and Git
• Handle data migration, warehousing, and validation tasks
Requirements
• 8+ years of experience in ETL development and production support
• Strong experience with on-premises to AWS migration
• Hands-on experience with DataStage or Informatica
• Proficiency in AWS services including Glue, Lambda, S3, EC2, and Step Functions
• Strong programming skills in Python, PySpark, Perl, and Shell Scripting
• Experience with SQL, DB2, Redshift, and Aurora PostgreSQL
• Knowledge of Airflow DAGs, REST/SOAP APIs, Jenkins, Git, and CI/CD
• Experience with data migration, data warehousing, and data validation