Loading...
Entry LevelFull-timePythonGCPKubernetesTerraformMachine LearningCI/CDGitAIAPI
Salary Range
$24,480 - $33,120 /year
This salary is estimated based on similar roles. The actual salary may vary.
Project Description:
We are looking for Data Engineer to join our team in DBIZ. The Technik Value Stream teams are responsible for Data Ingest on One Data Entry (ODE), development of the relevant data products on ODE, Operations of the data products on ODE
Activity description and concrete tasks:
• Infrastructure Deployment & Management: Efficiently deploy and manage infrastructure on Google Cloud Platform (GCP) including network architectures (Shared VPC, Hub-and-Spoke), security implementations (IAM, Secret Manager, firewalls, Identity-Aware Proxy), DNS configuration, VPN, and Load Balancing.
• Data Processing & Transformation: Utilize Hadoop cluster with Hive for querying data, and PySpark for data transformations. Implement job orchestration using Airflow.
• Core GCP Services Management: Work extensively with services like Google Kubernetes Engine (GKE), Cloud Run, BigQuery, Compute Engine, and Composer, all managed through Terraform.
• Application Implementation: Develop and implement Python applications for various GCP services.
• CI/CD Pipelines: Integrate and manage GitLab Magenta CI/CD pipelines for automating cloud deployment, testing, and configuration of diverse data pipelines.
• Security & Compliance: Implement comprehensive security measures, manage IAM policies, secrets using Secret Manager, and enforce identity-aware policies.
• Data Integration: Handle integration of data sources from CDI, Datendrehscheibe (FTP servers), TARDIS API´s and Google Cloud Storage (GCS).
• Multi-environment Deployment: Create and deploy workloads across Development (DEV), Testing (TEST), and Production (PROD) environments.
• AI Solutions: Implement AI solutions using Google’s Vertex AI for building and deploying machine learning models.
• Certification Desired: Must be a certified GCP Cloud Architect or Data Engineer.
Free to sign up. Takes 30 seconds.
About T SystemsIberia
T SystemsIberia is a leading IT and consulting company operating within the technology services sector, specializing in providing innovative solutions to businesses across Spain and the broader Iberian region. As a subsidiary of the global T-Systems International Group, the company leverages its parent organization's extensive expertise while tailoring its offerings to meet the specific needs of local and regional clients. Established to bridge the gap between cutting-edge technology and practical business applications, T SystemsIberia focuses on delivering reliable, scalable solutions that drive digital transformation and operational efficiency for its clients. The company offers a comprehensive suite of services, including IT infrastructure management, cybersecurity solutions, process optimization, and digital consulting. Key features of their offerings include advanced cloud computing capabilities, end-to-end network services, and bespoke software development tailored to industry-specific requirements. T SystemsIberia primarily targets large enterprises and public sector organizations, providing them with the technical expertise and strategic guidance needed to navigate complex digital challenges. Their solutions are designed to enhance connectivity, security, and performance, ensuring clients remain competitive in an increasingly digital landscape. T SystemsIberia has distinguished itself through its commitment to innovation and customer-centric approach, earning a reputation as a trusted partner in the technology sector. The company's strong market position is bolstered by its affiliation with T-Systems International, which provides access to global resources and best practices. By combining technical excellence with deep industry knowledge, T SystemsIberia delivers unique value propositions that help organizations achieve their digital goals while maintaining robust security and compliance standards.
