AWS Data Engineer
Siddharth GadheUnited StatesMIDPosted 2h ago
PythonPySparkAWS GlueEMRS3RedshiftAthenaSQLETLELTData Pipeline DevelopmentData QualityPerformance OptimizationApache IcebergDynamoDB
About the Role
We are looking for an AWS Data Engineer to join our team. This role focuses on building and maintaining data pipelines on AWS.
Key Responsibilities
• Develop and maintain ETL/ELT processes using Python and PySpark
• Work with AWS services including Glue, EMR, S3, Redshift, and Athena
• Design and implement data pipelines for data processing and analysis
• Ensure data quality and optimize performance of data solutions
• Utilize technologies like Apache Iceberg and DynamoDB
Requirements
• Strong experience with Python and PySpark
• Proficiency with AWS data services (Glue, EMR, S3, Redshift, Athena)
• Experience with SQL and database design
• Knowledge of ETL/ELT processes and data pipeline development
• Understanding of data quality principles and performance optimization techniques