Data Engineer
Tanuja PenumatsaUnited StatesMIDPosted 14d ago
AWS GlueAmazon EMRRedshiftAthenaS3PythonPySparkSQLKafkaApache AirflowDockerGitSnowflakedbtIcebergDelta LakeLambdaStep Functions
About the Role
We are seeking an AWS Data Engineer with expertise in big data processing, cloud-native data engineering, and streaming architectures. The ideal candidate should possess strong experience building enterprise data platforms using AWS analytics services.
Key Responsibilities
• Develop scalable AWS data pipelines
• Build ETL jobs using AWS Glue
• Develop PySpark applications on EMR
• Design Redshift data warehouse solutions
• Develop streaming pipelines using Kafka
• Build data orchestration workflows using Airflow
• Optimize cloud data processing
• Develop REST APIs for data services
• Implement data quality monitoring
Requirements
• AWS Glue
• Amazon EMR
• Redshift
• Athena
• S3
• Python
• PySpark
• SQL
• Kafka
• Apache Airflow
• Docker
• Git
• Snowflake
• dbt
• Iceberg
• Delta Lake
• Lambda
• Step Functions
• ETL
• Python