Loading...
SeniorFull-timeKubernetesElasticsearchMicroservicesData ScienceCI/CDAPI
Salary Range
$132,600 - $179,400 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are looking for a Senior Data Engineer to join our data-intensive product team at Kpler. This role involves building and operating core data pipelines and backend systems that model and deliver insights on global refinery operations and economics.
Key Responsibilities
- →Design, build, and evolve batch and streaming data pipelines that power refinery modeling, analytics, and customer-facing products.
- →Own complex data ingestion, transformation, validation, and delivery workflows across multiple data sources.
- →Drive improvements in pipeline reliability, scalability, and observability, including retries, backfills, data quality checks, and monitoring.
- →Lead schema design, versioning, and evolution strategies to support stable, long-lived data contracts.
- →Build and maintain backend components and APIs used to serve data to downstream systems and applications.
- →Partner closely with data scientists, product managers, and other engineers to translate domain requirements into robust technical solutions.
- →Continuously improve existing systems as data volume, complexity, and product expectations grow.
Requirements
- ✓Deliver high-quality, well-tested, and maintainable code, setting a strong example for engineering best practices.
- ✓Own significant parts of the data platform end-to-end, from ingestion to production delivery.
- ✓Make architectural contributions to data processing, storage, and delivery patterns.
- ✓Contribute to and improve CI/CD pipelines, automation, and operational tooling.
- ✓Instrument services and pipelines with metrics, logs, and alerts, and help define operational standards.
- ✓Play an active role in incident response, root-cause analysis, and long-term system improvements.
- ✓Review code, mentor other engineers, and help reinforce shared coding and architectural standards across the team.
