Jobs → Data & Analytics → AWS Data Engineer

About the Role We are looking for an experienced AWS Data Engineer with strong expertise in cloud data engineering, Azure-to-AWS migration, PySpark, and data lakehouse technologies. Key Responsibilities • Design, develop, and optimize cloud-based data pipelines • Execute Azure-to-AWS data and pipeline migration • Implement secure data processing workflows in compliance with GDPR • Diagnose and resolve complex data pipeline issues • Translate business requirements into scalable technical solutions Requirements • 5+ years of experience in AWS Data Engineering • 4+ years of core cloud experience • Hands-on experience with AWS Glue, Amazon Redshift, Amazon S3, and AWS Lambda • Building and maintaining production-grade data pipelines • Strong knowledge of AWS Redshift and SQL • Experience with Azure Data Factory (ADF) • Hands-on experience with Azure Databricks and PySpark notebooks • Experience migrating data pipelines from Azure to AWS • Experience working with API-based and cloud data sources other than AWS • Hands-on experience with open-source table formats such as Apache Iceberg, Apache Hudi, and Delta Lake • Experience creating and managing DevOps pipelines for AWS services • Hands-on migration of data and pipelines from Azure Data Factory, Databricks, and SQL Server to AWS • Experience with AWS Redshift, S3 Data Lakehouse, and AWS Glue • Strong Python and PySpark programming skills • Advanced SQL scripting • Experience designing scalable and reliable data pipelines • Strong understanding of GDPR regulations • Practical experience handling PII securely • Data masking, anonymization, and pseudonymization workflows across Amazon S3 and Redshift