AWS Data Engineer
Anil ManamalaUnited StatesSENIORPosted 3h ago
ETL DevelopmentData EngineeringData WarehousingAWS GluePySparkPythonDataStageInformaticaDB2AWS RedshiftAurora PostgreSQLS3LambdaStep FunctionsApache AirflowDAGsETL orchestrationSQLUnix/LinuxShell/Korn ShellPerlREST/SOAP APIsGit/BitbucketJenkinsCI/CDTableauAI/MLInfrastructure as Code
About the Role
We are looking for an AWS Data Engineer to join our team for a long-term contract opportunity. This role involves working on enterprise AWS cloud migration projects and requires extensive experience in data engineering and ETL development.
Key Responsibilities
• Design and implement ETL processes using AWS Glue, PySpark, and Python
• Migrate legacy on-premises ETL jobs from DataStage/Informatica and DB2 to AWS
• Manage data warehousing solutions using AWS Redshift, Aurora PostgreSQL, S3, Lambda, and Step Functions
• Develop and maintain Apache Airflow DAGs for ETL orchestration
• Ensure data validation, data quality, and provide production support
• Work with REST/SOAP APIs and implement CI/CD practices
Requirements
• 8+ years of experience in ETL Development, Data Engineering, and Data Warehousing
• Strong hands-on experience with AWS Glue, PySpark, and Python
• Experience migrating legacy on-premises ETL jobs using DataStage/Informatica and DB2 to AWS
• Strong knowledge of AWS Redshift, Aurora PostgreSQL, S3, Lambda, and Step Functions
• Experience with Apache Airflow, DAGs, and ETL orchestration
• Strong SQL, Unix/Linux, Shell/Korn Shell, and Perl scripting skills
• Experience with REST/SOAP APIs, Git/Bitbucket, Jenkins, and CI/CD
Benefits
• 100% Remote Opportunity
• Long-Term Contract
• Opportunity to work on enterprise AWS cloud migration projects