Loading...
Mid LevelFull-timePythonJavaGolangRustKubernetesCI/CDAIML
Salary Range
$69,360 - $93,840 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are looking for a Data Platform Engineer to join Adyen, where you will build the foundational layer of tooling and processes for our on-premise Analytical Data Platforms. This role focuses on improving our internal Online Analytical Processing (OLAP) ecosystem and collaborating with Data and ML Engineers.
Key Responsibilities
- →Develop and maintain high-performance OLAP systems, supporting multi-tenant query workloads and ingestion pipelines with real Big Data scale.
- →Ensure high availability for business-critical analytical products through observability and engineering excellence.
- →Build self-service tooling that enables Data Engineers and Analysts to independently manage their data assets and diagnose issues.
- →Engineer automated frameworks to validate data integrity and leverage metadata-driven tools to enhance data discoverability, lineage, and cataloging across the ecosystem.
- →Architect seamless integrations of the OLAP ecosystem with adjacent distributed systems (e.g., storage, messaging, and batch/stream processing systems).
- →Monitor and optimize cluster resource-efficiency while ensuring the platform adheres to global security and data privacy standards.
Requirements
- ✓Fluency in Python and/or Java. Golang or Rust are also appreciated.
- ✓Team player with strong communication skills.
- ✓Experience in OLAP technologies, like Druid, Clickhouse, Pinot, Doris, Starrocks, etc.
- ✓Experience in CI/CD pipelines for code and infrastructure automation.
- ✓Experience in Kubernetes.
- ✓Experience in infrastructure and large-scale private cloud systems.
- ✓Additional experience developing and maintaining other distributed data and compute systems like Spark, Trino, etc.
- ✓Data modeling for databases.
- ✓Real-time and batch data pipelines (via Kafka, Spark streaming) with an emphasis on user friendliness and quality.
Free to sign up. Takes 30 seconds.
