AWS Data Engineer
Shravan ChiduralaUnited StatesSENIORPosted 2h ago
AWSMDMPythonSQLReltioCloud FormationTerraformEC2EMRDMSGLUES3Lake FormationRedshiftVPCIAMCloudWatchSQSLambdaCloudTrailSystems ManagerKMSKinesis StreamsNoSQLScalaC#GobashPowerShell
About the Role
We are looking for an experienced AWS Data Engineer to join our team. This role involves building and operating highly available, distributed systems for data extraction, ingestion, and processing of large data sets.
Key Responsibilities
• Build and maintain automated methods of orchestrating data flows and products while supervising data quality and the status of related infrastructure
• Implement secure cloud data solutions which align to privacy and security controls
• Enable and support data and analytics capabilities and technologies
• Research, analyze, recommend and select technical approaches for solving sophisticated development and integration problems
• Implement additional project components (API interfaces) for accessibility
• Contribute to the overall data platform architecture and evolution
Requirements
• Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
• Working knowledge of modern data architectures and trends such as Data Mesh, Data Lakehouse
• Experience with Master Data Management (MDM) implementation involving platforms like Reltio, Informatica
• Experience with data concepts (SQL, NoSQL, Normalization) and working with sophisticated data structures
• Experience with Infrastructure-as-code tools such as Cloud Formation and Terraform
• Experience in designing and implementing cloud data solutions using a broad range of AWS technologies
• Proficiency in one or more of the following scripting languages: SQL, Python, Scala, C#, or Go
• Solid understanding of scripting languages such as bash or PowerShell
• Track record of successfully building scalable Data Lake solutions
• Must have a background in data engineering – Data Warehouse, ETL/ELT and BI experience
• Familiarity with modern engineering practices, including agile development, CI/CD and devops.