AWS Data Engineer
Suresh KumarUnited StatesSENIORPosted 1h ago
AWSPythonSQLBig DataETLApache AirflowAWS GlueAWS RedshiftAWS EMRAWS AthenaAWS LambdaAWS KinesisHadoopSparkKafkaOracleSQL ServerPostgreSQLCassandra
About the Role
We are looking for an experienced Data Engineer with strong expertise in AWS cloud services, big data technologies, SQL, Python, ETL development, and data analytics.
Key Responsibilities
• Design and maintain scalable data pipelines and ETL architectures
• Develop cloud-based data solutions using AWS S3, Glue, Redshift, EMR, Athena, Lambda, and Kinesis
• Build data orchestration workflows using Apache Airflow and AWS Step Functions
• Integrate, transform, and process large datasets from multiple sources
• Develop analytical models, dashboards, and reporting solutions
• Implement data quality, validation, monitoring, and governance frameworks
• Optimize data infrastructure and automate data processing workflows
• Collaborate with data scientists, research analysts, and business stakeholders
• Support data migration, system modernization, and enterprise data initiatives
Requirements
• Advanced SQL and database management
• AWS Cloud Services (S3, EC2, Glue, EMR, RDS, Redshift, Athena, Lambda, DynamoDB)
• Programming: Python, R, Java, Scala, or C++
• Relational and NoSQL databases: Oracle, SQL Server, PostgreSQL, Cassandra
• Big Data: Hadoop, Spark, Kafka
• Workflow Management: Apache Airflow, Luigi, Azkaban
• Data Modeling: Star Schema, Snowflake Schema, Dimensional Modeling, Data Vault
• Git, CI/CD pipelines, REST APIs, and data integration
• Data Governance, Data Lineage, Metadata Management, and Data Quality
• Informatica, MuleSoft, Talend, TIBCO, and stream-processing technologies