AWS Data Engineer
Rohit TyagiUnited StatesSENIORPosted 11d ago
AWS GlueLambdaS3RedshiftRDSIAMInformatica IDMCData IntegrationData CatalogData LineagePythonSQLShell ScriptingAWS CloudFormationInfrastructure as CodeJenkinsGitHubBitbucketSonarQubeCI/CD PipelinesETLELTData IngestionAWS Data LakeAWS Data WarehouseAWS EMRSparkAthenaStep FunctionsKinesisKafkaManaged AirflowDockerArtifactoryDevOps automationDenodoAtaccamaData Quality tools
About the Role
We are looking for an experienced AWS Data Engineer to join our team. This role focuses on developing and maintaining cloud data pipelines using AWS services and Informatica IDMC.
Key Responsibilities
• Design and implement data pipelines using AWS Glue, Lambda, and S3
• Manage data warehousing solutions with Redshift and RDS
• Implement and maintain IAM policies for secure data access
• Develop and maintain ETL/ELT processes for data ingestion
• Utilize AWS CloudFormation for infrastructure as code
• Implement CI/CD pipelines using Jenkins, GitHub, and SonarQube
• Ensure data quality using Denodo, Ataccama, and other data quality tools
Requirements
• 8+ years of experience in AWS data engineering
• Strong knowledge of AWS Glue, Lambda, S3, Redshift, RDS, and IAM
• Hands-on experience with Informatica IDMC for data integration, catalog, and data lineage
• Proficiency in Python, SQL, and Shell Scripting
• Experience with AWS CloudFormation and infrastructure as code
• Familiarity with Jenkins, GitHub, Bitbucket, SonarQube, and CI/CD Pipelines
• Experience with ETL/ELT, data ingestion, and AWS Data Lake/Data Warehouse
• AWS Solutions Architect or AWS Developer Certification
Preferred Skills
• Experience with AWS EMR/Spark, Athena, and Step Functions
• Knowledge of Kinesis, Kafka, and Managed Airflow
• Experience with Docker, Artifactory, and DevOps automation
• Familiarity with Denodo, Ataccama, and other data quality tools