Data Engineer Java / Scala
Aya OuhmaneRemoteMIDPosted 10h ago
JavaScalaSparkKafkaSQLBigQueryGCPDBTPub/SubGitLab CI/CDDockerLinux
About the Role
We are looking for a Data Engineer with Java and Scala expertise to join our Agile team. This role involves working on a strategic data platform that manages product stocks and availability in real-time.
Key Responsibilities
• Design and maintain data pipelines, both streaming and batch
• Develop real-time processing in Java/Scala using Spark and Kafka
• Optimize SQL performance on large volumes
• Develop APIs for data exposure
• Implement automated testing and CI/CD
Requirements
• Solid experience in Java and/or Scala
• Good mastery of functional programming
• Apache Kafka and Apache Spark
• Google BigQuery and advanced SQL
• Excellent written and spoken French
A plus
• GCP, DBT, Pub/Sub, GitLab CI/CD, Docker, Linux