Loading...
Mid LevelFull-timePythonJavaKubernetesCI/CDGitGo
Salary Range
$61,200 - $82,800 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are looking for an experienced Data Engineer to join the DatahubV2 development team. This role requires expertise in Java, Spark, and modern data architectures.
Key Responsibilities
- →Design, develop, and optimize high-performance data pipelines (batch, distributed computing).
- →Develop Spark 3 processing instances on Kubernetes (Spark as a Service).
- →Manipulate DatahubV2 data via Starburst (Trino) using SQL.
- →Build and orchestrate data workflows on Astronomer / Apache Airflow using Python.
- →Perform application integrations in Java (and potentially Scala depending on applications).
- →Ensure quality, performance, and reliability of data jobs.
- →Contribute to the implementation and maintenance of DevOps pipelines (Gitlab, Jenkins, ArgoCD).
- →Monitor and analyze application logs via ELK (Log as a Service).
- →Collaborate with the Data Foundation team, use and evolve internal Python libraries.
- →Participate in documentation and continuous improvement of DatahubV2 data practices.
Requirements
- ✓Advanced skills in Spark 3 and Java or Scala.
- ✓Experience with distributed processing, performance optimization, and execution on Kubernetes.
- ✓Intermediate skills in Starburst (Trino) and SQL.
- ✓Intermediate skills in Apache Airflow / Astronomer and Python.
- ✓Basic understanding of Kubernetes, COS (S3), and Vault.
- ✓Intermediate skills in Log as a Service (ELK).
- ✓Basic skills in Gitlab, Jenkins, ArgoCD, Ansible, Go, and Yaml.
- ✓Proficiency in Java, SQL, Python, and Scala.
Free to sign up. Takes 30 seconds.
About Inetum2
Inetum2 is a technology consulting and services company specializing in digital transformation and IT solutions. Operating within the IT services industry, the company focuses on leveraging cutting-edge technologies to help businesses adapt and thrive in a rapidly evolving digital landscape. While the name suggests a connection to the larger Inetum group, Inetum2 operates as a distinct entity, likely founded to address specific market needs or regional demands, though precise founding details are not explicitly stated. The company’s approach combines technical expertise with strategic advisory to deliver tailored solutions that align with client objectives. Inetum2 offers a range of products and services, including software development, system integration, cloud computing, and process optimization. Key features of their offerings include agile methodologies, scalable solutions, and a strong emphasis on cybersecurity and data privacy. Their target audience primarily consists of mid-to-large enterprises across sectors such as finance, healthcare, and manufacturing, which require robust IT infrastructure and innovative digital strategies to enhance operational efficiency and competitive advantage. The company’s solutions are designed to integrate seamlessly with existing systems while future-proofing clients’ technological investments. Notable achievements for Inetum2 may include successful client transformations and partnerships with industry leaders, though specific accolades are not detailed. The company’s market position is strengthened by its ability to provide end-to-end digital services, from initial consultation to ongoing support. Its unique value proposition lies in its blend of technical proficiency and business acumen, ensuring that solutions not only meet technical requirements but also drive tangible business outcomes. This dual focus positions Inetum2 as a trusted partner for organizations navigating complex digital challenges.
