AWS Data Engineer
Nagendra .United StatesSENIORPosted 4h ago
AWSS3GlueRedshiftEMRAthenaLambdaPythonSQLETLELTApache SparkHadoopKafkaApache AirflowAWS Step FunctionsData WarehousingData ModelingREST APIsData GovernanceData QualityData MigrationGitCI/CD
About the Role
We are looking for an experienced AWS Data Engineer to join our team. This role focuses on designing, developing, and maintaining scalable cloud-based data solutions and ETL pipelines.
Key Responsibilities
• Design and develop scalable cloud-based data solutions
• Develop and maintain ETL/ELT pipelines
• Implement data integration solutions
• Work with Apache Spark, Hadoop, and Kafka
• Utilize Apache Airflow and AWS Step Functions for workflow management
• Ensure data quality and governance
Requirements
• Strong hands-on experience with AWS (S3, Glue, Redshift, EMR, Athena, Lambda)
• Excellent Python and Advanced SQL skills
• Experience with ETL/ELT pipeline development
• Hands-on experience with Apache Spark, Hadoop, and Kafka
• Experience with Apache Airflow and AWS Step Functions
• Strong knowledge of Data Warehousing and Data Modeling
• Experience with REST APIs, Data Governance, Data Quality, and Data Migration
• Experience with Git and CI/CD pipelines
• Previous State Government project experience is required
Preferred
• Experience with Higher Education, Student, Employment, or Workforce datasets
• Public-sector data modernization and migration projects
• Analytics, predictive modeling, and Machine Learning exposure