Python Developer / AWS Data Engineer
Anshika SeedwanUnited StatesSENIORPosted 6d ago
PythonAWSEMRLambdaEventBridgeStep FunctionsRedshiftS3GlueApache SparkPySparkHadoopHiveSQLAPI integrationETLGitLabCI/CDTerraform
About the Role
We are looking for an experienced Python Developer / AWS Data Engineer with strong expertise in Python programming, AWS cloud services, and big data engineering to join our team.
Key Responsibilities
• Design and implement solutions using Python and AWS services
• Develop and optimize ETL pipelines for processing large datasets
• Utilize AWS EMR, Lambda, EventBridge, Step Functions, Redshift, S3, and Glue
• Work with Apache Spark, PySpark, Hadoop, and Hive for data processing
• Integrate APIs and transform data using SQL
• Implement CI/CD pipelines using GitLab and Terraform
Requirements
• 10+ years of hands-on Python development experience
• 5+ years of AWS development experience
• Strong knowledge of AWS EMR, Lambda, EventBridge, Step Functions, Redshift, S3, and Glue
• Experience with Apache Spark, PySpark, Hadoop, and Hive
• Strong SQL, API integration, and data transformation skills
• Experience building and optimizing ETL pipelines
• Hands-on experience with GitLab, CI/CD pipelines, and Terraform
• Strong analytical, problem-solving, and communication skills