AWS Data Engineer
Lan AnhRemoteSENIORPosted 1h ago
AWS GlueEMR ServerlessRedshiftAWS MWAAApache AirflowDAGsPythonPySparkSQLETLELTS3LambdaIAMData IntegrationData QualityUAT
About the Role
We are looking for an experienced AWS Data Engineer to join our team. This role focuses on developing and maintaining data pipelines on AWS.
Key Responsibilities
• Develop and maintain ETL/ELT pipelines using AWS services
• Implement data integration solutions and ensure data quality
• Design and manage data workflows using Apache Airflow
• Work with Python, PySpark, and SQL for data processing
• Utilize AWS services like Glue, EMR, Redshift, S3, Lambda, and IAM
Requirements
• Strong experience with AWS Glue, EMR Serverless, Redshift
• Proficiency with AWS MWAA and Apache Airflow, including DAGs
• Expertise in Python, PySpark, and SQL
• Experience with ETL/ELT Pipeline Development
• Knowledge of Data Integration, Data Quality, and UAT processes