Loading...
SeniorFull-timePythonRustAWSTerraformMachine LearningCI/CDAIMLData
Salary Range
CA$145,000 - CA$154,000 /year
About the Role
We are looking for a Senior Data Engineer to join our team at Wave. This role involves building tools and infrastructure to support data products and insights teams, helping Wave transform into a data-centric organization.
Key Responsibilities
- →Design, build, and deploy components of a modern data platform, including CDC-based ingestion using Debezium and Kafka, a centralized Hudi-based data lake, and various data pipelines.
- →Maintain and enhance existing Amazon Redshift data warehouse and legacy Python ELT pipelines while transitioning to a new Databricks-based environment.
- →Build fault-tolerant, scalable, and cost-efficient data systems, improving observability and reliability.
- →Collaborate with cross-functional teams to plan and roll out data infrastructure supporting analytics, machine learning, and GenAI use cases.
- →Respond to PagerDuty alerts, troubleshoot incidents, and implement monitoring to maintain high availability.
- →Provide technical guidance and clearly explain complex concepts to colleagues.
- →Assess existing systems, improve data accessibility, and deliver solutions for actionable insights.
Requirements
- ✓6+ years of experience in building data pipelines and managing a modern data stack.
- ✓3+ years of experience with AWS cloud infrastructure, including Kafka, Spark, AWS Glue, and Terraform.
- ✓Fluency in SQL and strong understanding of data modeling principles for both OLTP and OLAP.
- ✓Experience developing or maintaining production data systems on Databricks.
- ✓Strong coding skills in Python, SQL, and dbt.
- ✓Prior experience building data lakes on S3 using Apache Hudi with various file formats.
- ✓Experience with CI/CD best practices for data pipeline solutions.
