AWS Data Engineer
Nithish JayaprakashUnited StatesSENIORPosted 44m ago
AWS Data EngineeringS3GlueRedshiftAthenaLambdaPythonAdvanced SQLPySparkApache SparkDistributed Data ProcessingETL/ELT PipelinesSQL QueryPerformance OptimizationData LakesLakehouseData WarehousingApache AirflowGitCI/CDAutomated TestingKafkaAmazon KinesisAmazon BedrockLLMsVector Databases
About the Role
We are looking for a Data Engineer to join our team in Indianapolis, IN. This role focuses on building scalable data solutions using AWS technologies.
Key Responsibilities
• Design and implement AWS Data Engineering solutions using S3, Glue, Redshift, Athena, and Lambda
• Develop ETL/ELT pipelines for data processing
• Optimize SQL queries and database performance
• Work with data lakes, lakehouse, and data warehousing solutions
• Implement Apache Airflow for workflow management
• Utilize Git, CI/CD, and automated testing for development
Requirements
• Experience with AWS Data Engineering (S3, Glue, Redshift, Athena, Lambda)
• Proficiency in Python, Advanced SQL, and PySpark
• Knowledge of Apache Spark and distributed data processing
• Experience with ETL/ELT Pipelines
• Understanding of SQL Query and Performance Optimization
• Familiarity with Data Lakes, Lakehouse, and Data Warehousing
• Experience with Apache Airflow
• Knowledge of Git, CI/CD, and Automated Testing