Jobs → Data & Analytics → AWS Data Engineer & Insights Analyst

About the Role We are looking for an experienced Data Engineer & Insights Analyst to support the Pennsylvania Longitudinal Data System (PALDS). Key Responsibilities • Design, build, and optimize scalable data pipelines and ETL workflows • Develop cloud-based data solutions using AWS services (S3, Glue, Redshift, EMR, Athena, Lambda) • Work with large and complex datasets using SQL, Python, Spark, and Kafka • Build and maintain data orchestration workflows using Apache Airflow or AWS Step Functions • Develop dashboards, reports, analytical models, and decision-support solutions • Implement data quality, governance, monitoring, and validation frameworks • Integrate data from multiple sources to support education and workforce analytics Requirements • 5+ years of hands-on AWS Data Engineering experience • Strong SQL and Python/R/Java/Scala programming skills • Experience with relational and NoSQL databases • Big Data technologies: Hadoop, Spark, Kafka • ETL/ELT and workflow orchestration tools: Airflow, Luigi, Azkaban • Data modeling: Star Schema, Snowflake Schema, and Data Vault • AWS Glue Data Catalog and metadata management • Git, CI/CD, REST APIs, and data governance • Experience with Informatica, MuleSoft, Talend, or TIBCO • Experience with stream-processing technologies Preferred Background • Experience working with higher education/student-level data, employment and wage datasets, and longitudinal data analytics