[Job-25818] Senior Data Engineer (Databricks), Brazil at CI&T

CI&T

Brazil·1d ago

SeniorFull-timePythonAWSGCPAzureCI/CDGitAI

Salary Range

$37,128 - $50,232 /year

Estimated

This salary is estimated based on similar roles. The actual salary may vary.

About the Role

We are looking for a Senior Data Developer with strong knowledge in developing and maintaining data pipelines in Databricks. This role involves integrating and transforming data from various sources while ensuring quality, reliability, security, and governance.

Key Responsibilities

→Develop and maintain data pipelines
→Integrate data from various sources such as APIs, relational databases, and files
→Collaborate with business and analytics teams to understand data requirements
→Ensure quality, reliability, security, and governance of ingested data
→Follow modern DataOps practices including code versioning, data tests, and CI/CD
→Document processes and best practices in data engineering

Requirements

✓Proven experience in building and managing large-scale data pipelines in Databricks using PySpark, Delta Lake, and SQL
✓Strong programming skills in Python and SQL for data processing and transformation
✓Deep understanding of ETL/ELT frameworks, data warehousing, and distributed data processing
✓Hands-on experience with modern DataOps practices: version control (Git), CI/CD pipelines, automated testing, and infrastructure-as-code
✓Familiarity with cloud platforms (AWS, Azure, or GCP) and related data services
✓Strong problem-solving skills with ability to troubleshoot performance, scalability, and reliability issues
✓Proficiency in Git
✓Advanced English speaking skills