AWS Data Engineer
Nitin MishraUnited StatesMIDPosted 13d ago
PythonPySparkAWS GlueDynamoDBS3LambdaStep FunctionsCloudWatchIAMKMSKinesisPostmanSQLGitCloudFormationTerraform
About the Role
We are looking for a Data Engineer with expertise in AWS services, particularly DynamoDB, to join our team. This role involves building and maintaining production data pipelines.
Key Responsibilities
• Develop and maintain production data pipelines using AWS services
• Implement ETL processes using Python and PySpark
• Optimize DynamoDB data models and performance
• Orchestrate workflows using AWS Glue, Step Functions, and other AWS tools
• Collaborate with teams to ensure data integrity and efficiency
Requirements
• Expert level proficiency in Python for data processing and ETL development
• Deep experience with AWS Glue, including job development and workflow orchestration
• Strong expertise in DynamoDB data modeling, capacity planning, and performance optimization
• Solid understanding of AWS ecosystem: S3, Lambda, Step Functions, CloudWatch, IAM, KMS, Kinesis
• Proficiency with Postman for API development and testing
• Strong SQL skills and understanding of data warehousing principles
• Experience with version control (Git), CI/CD tools, and infrastructure as code (CloudFormation/Terraform)