Loading...
SeniorFull-timeVuePostgreSQLMySQLCI/CDGit
Salary Range
$29,172 - $39,468 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are looking for a Big Data Engineer to join our Data team. This role focuses on designing, industrializing, and optimizing data pipelines in a Big Data environment. You will ensure the quality, traceability, and availability of datasets that feed business intelligence tools and analytical needs.
Key Responsibilities
- →Integrate data from various relational databases (PostgreSQL, SQL Server, MySQL, IBM DB2) and files using Sqoop/ETL.
- →Structure bronze/silver/gold zones and define schemas using Hive.
- →Develop and optimize Spark/PySpark jobs with techniques like partitioning, broadcast, cache, and bucketing.
- →Write efficient and maintainable SQL/HiveQL transformations.
- →Design and maintain Airflow DAGs for scheduling, retries, SLAs, and alerting.
- →Implement CI/CD pipelines using GitLab, Shell scripts, and DevOps best practices.
- →Implement data quality controls, unit tests, data tests, and documentation.
- →Ensure data lineage and incident management with RCAs and runbooks.
- →Publish analytics-ready datasets and optimize Power BI data feeds.
- →Contribute to KPI calculation and reliability.
Requirements
- ✓Experience with Big Data technologies (Hadoop/HDFS, Hive, Spark).
- ✓Knowledge of data ingestion tools (Sqoop, ETL).
- ✓Familiarity with relational databases (PostgreSQL, SQL Server, MySQL, IBM DB2).
- ✓Experience with workflow orchestration (Airflow).
- ✓Understanding of CI/CD principles and tools (GitLab, Shell).
- ✓Skills in data quality management and documentation.
- ✓Ability to work with BI tools like Power BI.
Free to sign up. Takes 30 seconds.
About Inetum2
Inetum2 is a technology consulting and services company specializing in digital transformation and IT solutions. Operating within the IT services industry, the company focuses on leveraging cutting-edge technologies to help businesses adapt and thrive in a rapidly evolving digital landscape. While the name suggests a connection to the larger Inetum group, Inetum2 operates as a distinct entity, likely founded to address specific market needs or regional demands, though precise founding details are not explicitly stated. The company’s approach combines technical expertise with strategic advisory to deliver tailored solutions that align with client objectives. Inetum2 offers a range of products and services, including software development, system integration, cloud computing, and process optimization. Key features of their offerings include agile methodologies, scalable solutions, and a strong emphasis on cybersecurity and data privacy. Their target audience primarily consists of mid-to-large enterprises across sectors such as finance, healthcare, and manufacturing, which require robust IT infrastructure and innovative digital strategies to enhance operational efficiency and competitive advantage. The company’s solutions are designed to integrate seamlessly with existing systems while future-proofing clients’ technological investments. Notable achievements for Inetum2 may include successful client transformations and partnerships with industry leaders, though specific accolades are not detailed. The company’s market position is strengthened by its ability to provide end-to-end digital services, from initial consultation to ongoing support. Its unique value proposition lies in its blend of technical proficiency and business acumen, ensuring that solutions not only meet technical requirements but also drive tangible business outcomes. This dual focus positions Inetum2 as a trusted partner for organizations navigating complex digital challenges.
