ETL/AWS Software Engineer
Rishabh RaghavRemoteSENIORPosted 1h ago
ETLAWSDataStageInformaticaAWS GluePySparkS3LambdaStep FunctionsRedshiftPythonPerlKorn ShellUnixSQLDB2Aurora PostgreSQLAmazon RDSAirflowREST APISOAP APIGitBitbucketJenkinsCI/CDAgile
About the Role
We are looking for experienced ETL/AWS Software Engineers to join our team. This role involves developing and maintaining ETL processes on the AWS cloud platform.
Key Responsibilities
• Develop and maintain ETL processes using DataStage or Informatica
• Migrate ETL processes from on-premises to AWS Cloud
• Work with AWS Glue, PySpark, S3, Lambda, Step Functions, and Redshift
• Design and implement ETL orchestration using Airflow DAGs
• Develop REST and SOAP APIs
• Provide production support, troubleshooting, and performance optimization
• Implement CI/CD pipelines using Git, Bitbucket, and Jenkins
Requirements
• 8+ years of experience in ETL development, data warehousing, and AWS
• Strong experience with DataStage or Informatica
• Proficiency in AWS Glue, PySpark, S3, Lambda, Step Functions, and Redshift
• Experience with Python, Perl, and Unix scripting
• Strong SQL and database experience with DB2, Aurora PostgreSQL, and Amazon RDS
• Experience with ETL orchestration using Airflow DAGs
• Knowledge of REST and SOAP API development
• Data analysis, validation, and data quality experience
• Production support, troubleshooting, and performance optimization skills
• Experience with Git, Bitbucket, Jenkins, and CI/CD
• Agile development experience