Loading...
SeniorFull-timeKubernetesDockerGit
Salary Range
$99,450 - $134,550 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are looking for a full-stack Data Engineer to build the backbone of our data infrastructure and own the end-to-end data lifecycle. This role involves architecting enterprise-grade systems and building products that drive digitalisation, while handling high-volume challenges such as processing half-hourly meter reads for energy customers.
Key Responsibilities
- →Design, build, and maintain robust ETL/ELT pipelines to ingest large-scale datasets and high-frequency streams.
- →Lead the design and evolution of our enterprise data warehouse, ensuring it is scalable and performant.
- →Manage our data transformation layer using Dataform or dbt to orchestrate complex, reliable workflows.
- →Implement automated testing frameworks and deploy scalable services using Docker and Kubernetes.
- →Act as a strategic partner to Product and Engineering, facilitating data design sessions.
- →Raise the bar for technical excellence through code reviews, design sessions, and documenting best practices.
Requirements
- ✓Experience with ETL/ELT pipeline design and implementation.
- ✓Knowledge of enterprise data warehousing concepts.
- ✓Familiarity with Dataform or dbt for data transformation.
- ✓Proficiency with Docker and Kubernetes for deployment.
- ✓Strong understanding of automated testing frameworks.
