AWS Data Engineer
Deepanshu BaberwalUnited StatesSENIORPosted 1h ago
PythonPySparkAWS GlueDynamoDBETLS3LambdaStep FunctionsCloudWatchIAMKMSKinesisPostmanSQLGitCI/CDTerraformCloudFormation
About the Role
We are looking for an experienced AWS Data Engineer with strong expertise in Python, PySpark, AWS Glue, and DynamoDB to build and optimize scalable, production-grade data pipelines.
Key Responsibilities
• Design and develop enterprise-scale data solutions
• Optimize production-grade data pipelines
• Implement ETL processes and automation
• Manage AWS Glue Jobs, Crawlers, Triggers, and Workflow Orchestration
• Handle Amazon DynamoDB Data Modeling, Capacity Planning, Streams, and Performance Optimization
Requirements
• Strong hands-on experience in Data Engineering and production data pipeline development
• Expert-level proficiency in Python, PySpark, ETL development, and automation
• Extensive experience with AWS Glue – Jobs, Crawlers, Triggers, and Workflow Orchestration
• Strong expertise in Amazon DynamoDB – Data Modeling, Capacity Planning, Streams, and Performance Optimization
• Hands-on experience with AWS services: S3, Lambda, Step Functions, CloudWatch, IAM, KMS, and Kinesis
• Proficiency in Postman for API development and testing
• Strong SQL skills and understanding of Data Warehousing concepts
• Experience with Git, CI/CD pipelines, and Infrastructure as Code (Terraform/CloudFormation)
• Familiarity with AI tools and their application in engineering workflows