AWS Data Engineer
Yash Raj Sharma AzadUnited StatesSENIORPosted 14d ago
PythonAWSAWS EMRLambdaEventBridgeStep FunctionsRedshiftS3GlueApache SparkHadoopHiveSQLAPI integrationETLCI/CDGitLabTerraform
About the Role
We are hiring experienced AWS Data Engineers with strong Python development skills for an urgent opportunity in Atlanta, GA. This role requires extensive experience with AWS data services and big data technologies.
Key Responsibilities
• Develop and maintain scalable data processing pipelines using Python and AWS services
• Design and implement ETL processes for data transformation and integration
• Utilize AWS EMR, Lambda, EventBridge, Step Functions, Redshift, S3, and Glue for data engineering tasks
• Work with Apache Spark, Hadoop, and Hive for big data processing
• Implement CI/CD practices using GitLab and Terraform
Requirements
• 10+ years of hands-on Python development experience
• 5+ years of AWS development experience
• Strong experience with AWS EMR, Lambda, EventBridge, Step Functions, Redshift, S3, and Glue
• Hands-on experience with Apache Spark, Hadoop, and Hive
• Strong SQL, API integration, data transformation, and ETL/data pipeline development skills
• Experience with CI/CD, GitLab, and Terraform