AWS Data Engineer
Abid KhanUnited StatesMIDPosted 2h ago
PythonPySparkAWS GlueDynamoDBS3LambdaStep FunctionsCloudWatchIAMKMSKinesisPostmanSQLGitCI/CDCloudFormationTerraformAI
About the Role
We are looking for an AWS Data Engineer to join our team. This role requires hands-on experience with building production data pipelines and expertise in AWS services.
Key Responsibilities
• Build and maintain production data pipelines
• Develop ETL processes using Python and PySpark
• Work with AWS Glue for job development, crawlers, and workflow orchestration
• Design and optimize DynamoDB data models
• Utilize AWS ecosystem services including S3, Lambda, and Kinesis
• Develop and test APIs using Postman
• Implement CI/CD pipelines and infrastructure as code
Requirements
• Expert-level proficiency in Python for data processing and ETL development
• Deep experience with AWS Glue, DynamoDB, and other AWS services
• Strong SQL skills and understanding of data warehousing principles
• Experience with version control, CI/CD tools, and infrastructure as code
• Knowledge of AI tools