Data Engineer
Nikhil PariharUnited StatesMIDPosted 1h ago
AWSS3GlueRedshiftEMRAthenaKinesisLambdaAirflowStep FunctionsPythonRJavaC++ScalaSQLNoSQLOracleSQL ServerPostgresCassandraGitCI/CDdata modelingdimensionaldata vaultstar/snowflakebig data toolsHadoopSparkKafkaAirflowLuigiAzkabanstream processingStormSpark-Streaming
About the Role
We are looking for a Data Engineer who can turn data into decisions that matter. This role involves supporting a statewide longitudinal data system, building pipelines that connect education records to workforce outcomes, and powering real policy decisions.
Key Responsibilities
• Design and build cloud data pipelines on AWS (S3, Glue, Redshift, EMR, Athena, Kinesis, Lambda)
• Orchestrate workflows with Airflow / AWS Step Functions
• Build monitoring, alerting, and data quality frameworks
• Develop dashboards and decision-support products for executive users
• Partner with data scientists and policy analysts on reproducible research
Requirements
• 5+ years of experience with AWS cloud data services
• 5+ years of experience with Python / R / Java / C++ / Scala
• 5+ years of experience with SQL & NoSQL (Oracle, SQL Server, Postgres, Cassandra)
• 5+ years of experience with Git + CI/CD pipelines
• 5+ years of experience with data modeling (dimensional, data vault, star/snowflake)
• 5+ years of experience with big data tools (Hadoop, Spark, Kafka)
• 5+ years of experience with Airflow / Luigi / Azkaban
• 5+ years of experience with stream processing (Storm, Spark-Streaming)
• Bonus: student-level higher education data experience.