Data Engineer – AWS Data Platform
Astha NigamRemoteMIDPosted 11d ago
AWS S3AWS GlueAWS LambdaAWS Step FunctionsETLELTData migrationPythonSQLData lake architectureData partitioningDistributed processingData securityIAMMonitoringPerformance optimizationGitLabBitbucketAWS AthenaRedshiftLake FormationGlue Data CatalogApache AirflowIBM CognosAWS SageMaker
About the Role
We are looking for a skilled Data Engineer to join our team and work on scalable, cloud-native data solutions using AWS. This role focuses on building robust data pipelines, workflow orchestration, and large-scale data migration solutions.
Key Responsibilities
• Build robust data pipelines and workflow orchestration
• Develop large-scale data migration solutions
• Design and implement data lake architecture
• Ensure data security, IAM, monitoring, and performance optimization
• Utilize Python and SQL for data processing
Requirements
• 5+ years of experience in building data pipelines
• Strong hands-on experience with AWS S3, AWS Glue, and AWS Lambda
• Mandatory experience with AWS Step Functions
• Proficiency in ETL/ELT pipeline development
• Experience with data migration from legacy systems to AWS
• Strong proficiency in Python and SQL
• Knowledge of data lake architecture, data partitioning, and distributed processing
• Familiarity with GitLab/Bitbucket and version control