Data Engineer
Lohith TiruveedulaUnited StatesSENIORPosted 1h ago
AWSS3GlueRedshiftEMRAthenaKinesisLambdaSQLETLELTApache AirflowAWS Step FunctionsPythonPySparkBig Data
About the Role
We are looking for an experienced AWS Data Engineer to design, develop, and maintain scalable cloud-based data solutions. This role requires strong expertise in AWS services, big data technologies, SQL, ETL pipelines, and data orchestration.
Key Responsibilities
• Design and implement cloud-based data solutions using AWS S3, Glue, Redshift, EMR, Athena, Kinesis, and Lambda
• Build and maintain data orchestration workflows using Apache Airflow and AWS Step Functions
• Develop and optimize large-scale ETL/ELT data pipelines using SQL and big data technologies
• Build analytical data environments supporting machine learning, predictive modeling, and statistical analysis
• Develop data pipeline monitoring, logging, alerting, and data quality frameworks
• Create dashboards, reports, analytical models, and decision-support solutions
• Perform root-cause analysis and improve data processing, scalability, and performance
• Collaborate with data scientists, research analysts, business stakeholders, and cross-functional teams
• Ensure data governance, privacy, security, and compliance standards
Requirements
• Strong experience in AWS Data Engineering and cloud-based data solutions
• Advanced SQL and relational database knowledge
• Hands-on experience with AWS S3, Glue, Redshift, EMR, and Athena
• Experience with Python, PySpark, and big data technologies
• Expertise in ETL/ELT pipelines and data transformation
• Experience with Apache Airflow or AWS Step Functions
• Knowledge of Kinesis, Lambda, message queuing, and stream processing
• Experience developing dashboards, reports, and analytical models
• Strong analytical, problem-solving, communication, and project management skills