AWS Data Engineer with DynamoDB
Rahul kharatiUnited StatesMIDPosted 2h ago
PythonPySparkAWS GlueDynamoDBS3LambdaStep FunctionsCloudWatchIAMKMSKinesisPostmanSQLGitCI/CDCloudFormationTerraformAI tools
About the Role
We are looking for an AWS Data Engineer with DynamoDB expertise to join our team. This role involves building production data pipelines and working with various AWS services.
Key Responsibilities
• Build and maintain production data pipelines
• Develop ETL processes using Python and PySpark
• Work with AWS Glue for job development, crawlers, and workflow orchestration
• Design and optimize DynamoDB data models and performance
• Utilize AWS ecosystem services including S3, Lambda, and Kinesis
• Develop and test APIs using Postman
• Implement CI/CD pipelines and infrastructure as code
Requirements
• Expert-level proficiency in Python for data processing and automation
• Deep experience with AWS Glue and DynamoDB
• Strong understanding of the AWS ecosystem
• Proficiency with Postman for API development
• Strong SQL skills and data warehousing principles
• Experience with version control, CI/CD tools, and infrastructure as code
• Knowledge of AI tools