[Job-27186] Data Tech Lead (Azure & Databricks), Portugal at CI&T

We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions. With over 8,000 CI&Ters around the world, we’ve built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality.  Key Responsibilities Design, develop, and maintain scalable data pipelines using Azure Databricks (PySpark, Spark SQL, Delta Lake). Implement code-first data engineering solutions, following strong software engineering and DataOps principles. Build and orchestrate data ingestion and transformation pipelines using Azure Data Factory. Integrate data from multiple sources (APIs, relational databases, event-based systems, files, etc.). Apply ETL/ELT patterns for analytical and operational use cases. Ensure data quality, reliability, security, and governance, leveraging Azure-native services and Databricks capabilities. Collaborate closely with analytics, BI, and business teams to translate requirements into robust data solutions. Support analytics use cases using dbt (when applicable) and enable downstream consumption (e.g., Power BI). Take technical ownership of data engineering projects, contributing to architecture decisions and best practices. Implement and maintain unit, integration, and end-to-end tests for data pipelines. Apply CI/CD pipelines and DevOps best practices for data and infrastructure workloads. Document architectures, pipelines, standards, and best practices. Requirements Core Technical Skills Strong experience with Azure Databricks (Spark (PySpark, Spark SQL) Advanced Python skills (PySpark, Strong coding standards and clean code practices, Dependency management using Poetry, venv, or similar tools) Advanced SQL for data querying, transformation, and aggregation. Solid understanding of distributed data processing and large-scale data architectures. Data Platform & Analytics Hands-on experience with Azure Data Factory for orchestration and ingestion. Familiarity with dbt in analytics or transformation contexts. Basic knowledge of Power BI and how data models support BI/reporting use cases. Basic understanding of machine learning concepts, especially as they relate to data preparation and feature engineering. DevOps & Infrastructure Experience with Infrastructure as Code, preferably using Terraform on Azure. Familiarity with Azure DevOps practices (CI/CD pipelines, Code versioning). Soft Skills & Language Ability to take ownership and responsibility for data engineering projects. Strong problem-solving and communication skills. Advanced English (spoken) is essential. #LI-BM2 Why join us? - Competitive Salary   - Generous paid vacation days - Generous sick time  - 100% paid health & dental benefits starting day one  - Annual profit-sharing distribution  - Paid parental leave  - Dedicated career advisor   And so much more… Collaboration is our superpower, diversity unites us, and excellence is our standard.  We value diverse identities and life experiences, fostering a diverse, inclusive, and safe work environment. We encourage applications from diverse and underrepresented groups to our job positions.