Loading...
SeniorFull-timePythonAzureCI/CDGit
Salary Range
$37,128 - $50,232 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are looking for a Data Engineer to join our team at CI&T. This role focuses on modernizing our data infrastructure by migrating from on-premise Data Warehouses to a Data Lakehouse architecture on Microsoft Azure.
Key Responsibilities
- →Design and implement complex, scalable data architectures using Python/PySpark and SQL
- →Define modeling standards (Medallion Architecture) for the Lakehouse, ensuring structures like Star Schema and One Big Tables meet both technical performance and business needs
- →Establish and promote CI/CD practices, automated data quality testing, and proactive monitoring of costs and performance in the Databricks/Azure environment
- →Serve as the focal point for resolving complex problems, mentoring less experienced professionals, and positively influencing the team's engineering culture
Requirements
- ✓Deep expertise in Databricks (Delta Lake, Unity Catalog, Workflows/Jobs, and Pipelines) and orchestrators like Azure Data Factory or Airflow
- ✓Experience in query optimization, Spark tuning, and handling large volumes of data
- ✓Proven ability to transform ambiguous business requirements into robust data models (facts, dimensions, and abstraction layers)
- ✓Familiarity with development best practices (GitFlow, clean code, modularization, and design patterns)
- ✓Ability to navigate high-uncertainty environments, refining processes and translating executive needs into tangible technical solutions
Free to sign up. Takes 30 seconds.
