Loading...
Mid LevelFull-timePythonGoAzureAICI/CD
About the Role
We are seeking a Data Engineer to join our team and contribute to building scalable, intelligent solutions for large volumes of data. This role involves designing and maintaining robust data pipelines while collaborating with multidisciplinary teams to deliver data solutions aligned with business objectives.
Key Responsibilities
- →Design, develop, and maintain scalable and robust data pipelines
- →Create data ingestion, transformation, and modeling solutions using Databricks, Spark/PySpark, Cloudera, and Azure Data Factory
- →Ensure data quality, integrity, and usability throughout the entire pipeline
- →Design and maintain Data Lake and Data Warehouse solutions with data governance best practices
- →Work with concepts like Bronze, Silver, and Gold layers, Star Schema, Delta Tables, Delta Sharing, and analytical tables
- →Collaborate with technical and business teams to orchestrate solutions aligned with company goals
Requirements
- ✓Solid experience as a Data Engineer or similar role
- ✓Advanced knowledge of Cloudera (Hive, Impala, HDFS, etc)
- ✓Proficiency in SQL and Python/PySpark
- ✓Experience with Azure Databricks (workflows, jobs, delta tables, queries)
- ✓Experience with Azure Data Factory (ADF)
- ✓Knowledge of ETL/ELT and data pipelines
- ✓Experience with dimensional data modeling
- ✓Familiarity with Data Lake and Data Warehouse concepts
- ✓Understanding of data governance and quality
- ✓Experience with CI/CD practices applied to data environments
- ✓Strong communication and collaboration skills with multidisciplinary teams
- ✓Ability to work in dynamic environments and handle technically undefined scopes
- ✓Knowledge of code optimization in cloud environments
Benefits
- ★Health and dental insurance plans
- ★Food and meal vouchers
- ★Childcare assistance
- ★Extended parental leave
- ★Gym membership partnerships via Wellhub and TotalPass
- ★Profit and results sharing (PLR)
- ★Life insurance
- ★Continuous learning platform (CI&T University)
- ★Discount club
- ★Online wellness platform for physical and mental health
- ★Parenting courses
- ★Partnerships with online course platforms
- ★Language learning platform
