AWS Data Engineer
Ashok PuvvalaUnited StatesMIDPosted 1h ago
Amazon RedshiftAWS GlueAmazon S3LambdaStep FunctionsPythonPySparkSQLETLELTApache SparkAWS IAMCloudWatchGitCI/CD
About the Role
We are looking for an experienced AWS Data Engineer to join our team. This role focuses on building scalable data pipelines using AWS services and Amazon Redshift as a data warehouse platform.
Key Responsibilities
• Design and develop scalable ETL/ELT pipelines using AWS services
• Build data ingestion and transformation frameworks
• Develop and optimize data lake and warehouse solutions on AWS
• Implement data quality, reconciliation, and monitoring frameworks
• Optimize Redshift performance and cloud infrastructure costs
• Implement security controls and access management
• Support CI/CD, deployments, and production troubleshooting
Requirements
• Strong hands-on experience with Amazon Redshift
• Expertise in AWS Glue, Amazon S3, Lambda, and Step Functions
• Strong programming skills in Python and PySpark
• Advanced SQL and experience with large-scale datasets
• Experience developing ETL/ELT pipelines and data ingestion frameworks
• Strong understanding of data lakes, data warehouses, and dimensional modeling
• Experience with Apache Spark and distributed data processing
• Knowledge of AWS IAM, encryption, security, and access controls
• Experience with CloudWatch, monitoring, logging, and troubleshooting
• Hands-on experience with Git and CI/CD practices
• Strong performance optimization and production support skills