Data Engineer
HatchyardRemoteMIDPosted 36m ago
PythonSQLGCPBigQueryDataflowPub/SubCDCETL/ELTAWS GlueSparkLambdaEMRLarge-Scale Data Processing
About the Role
We are looking for Data Engineers to join our team. These roles focus on building scalable data engineering solutions.
Key Responsibilities
• Design and implement data pipelines using Python and SQL
• Work with cloud platforms like GCP and AWS
• Develop ETL/ELT processes and manage data flows
• Process large-scale data using tools like Spark and Lambda
Requirements
• 1-5 years of experience in data engineering
• Strong skills in Python and SQL
• Experience with cloud data services (GCP, AWS)
• Knowledge of BigQuery, Dataflow, Pub/Sub, AWS Glue, EMR
• Understanding of CDC, ETL/ELT processes and large-scale data processing