Python Developer
Abhishek DevdharUnited StatesSENIORPosted 2h ago
PythonBig DataAWSHadoopApache SparkHiveAmazon EMRAWS LambdaAmazon EventBridgeAWS Step FunctionsAmazon RedshiftAmazon S3AWS GlueSQLCI/CDGitLabTerraform
About the Role
We are looking for experienced Python Developers with strong Big Data and AWS expertise to join our growing team. This role focuses on building scalable data processing pipelines and developing high-performance data solutions.
Key Responsibilities
• Develop Python applications for Big Data environments
• Work with Hadoop/EMR, Apache Spark, and Hive
• Utilize AWS services including Amazon EMR, AWS Lambda, Amazon EventBridge, AWS Step Functions, Amazon Redshift, Amazon S3, and AWS Glue
• Handle API integration, SQL queries, data manipulation, transformation, analysis, and visualization
• Implement CI/CD pipelines using GitLab and Terraform
• Apply analytical and problem-solving skills to derive insights from large datasets
• Collaborate across cross-functional teams
Requirements
• 10+ years of hands-on experience developing Python applications for Big Data environments
• Strong experience with Hadoop/EMR, Apache Spark, and Hive
• 5+ years of development experience with AWS services
• Experience with API integration, SQL queries, data manipulation, transformation, analysis, and visualization
• Hands-on experience with CI/CD pipelines and tools such as GitLab and Terraform
• Strong critical thinking, troubleshooting, and data analysis skills
• Excellent communication and teamwork skills