Loading...
Mid LevelFull-timeAWSGCPAzureMachine LearningAgileCI/CDAI
Salary Range
$53,040 - $71,760 /year
This salary is estimated based on similar roles. The actual salary may vary.
Ai fini dell’ampliamento del nostro centro di competenza dedicato alla Data Engineering e all'Advanced Analytics, siamo alla ricerca di un/una Senior Databricks Data Engineer che operi come pilastro tecnico per la costruzione di architetture dati moderne. La risorsa garantirà la qualità dei processi di ingestione e trasformazione, promuovendo le best practice di sviluppo su ambienti Cloud (Azure/AWS/GCP) all'interno dei team di progetto.
Sarai responsabile di progettare, sviluppare e implementare pipeline di dati scalabili e performanti, coordinando l'ottimizzazione dei carichi di lavoro in collaborazione con i Data Scientist e i Data Architect.
In scenari complessi, guiderai il design dell'architettura Medallion (Bronze, Silver, Gold) e la gestione dei Delta Lake, risolvendo colli di bottiglia tecnici e garantendo la consegna di soluzioni robuste per il processamento di grandi volumi di dati (Batch e Streaming).
In un contesto orientato all'innovazione tecnologica con un’impostazione Business Oriented, ti occuperai di:
• Sviluppo Pipeline ETL/ELT: Progettazione e implementazione di flussi di dati complessi utilizzando Apache Spark (PySpark, Spark SQL, Scala);
• Gestione del Data Lakehouse: Ottimizzazione delle tabelle Delta Lake e implementazione di logiche di partizionamento e indexing per massimizzare le performance di lettura/scrittura;
• Data Governance & Security: Configurazione della sicurezza e del controllo accessi ai dati tramite Unity Catalog, garantendo la conformità alle policy aziendali;
• Collaborazione Agile: Cooperazione con i Data Scientist per l'integrazione di modelli di Machine Learning (MLflow) e con i Power BI Developer per l'esposizione di set di dati ottimizzati (Gold Layer);
• Automazione e Monitoraggio: Implementazione di workflow tramite Databricks Jobs, integrazione con strumenti di CI/CD e monitoraggio della qualità del dato (Data Quality checks).
Free to sign up. Takes 30 seconds.
About SopraSteria1
Sopra Steria is a leading European IT consulting and services company that provides digital transformation solutions to help organizations navigate the complexities of the modern business landscape. Established through the merger of Sopra Group and Steria in 2014, the company has built a strong reputation for delivering innovative technology strategies and operational excellence. Headquartered in France, Sopra Steria operates across multiple countries, leveraging decades of industry expertise to serve clients in various sectors, including finance, healthcare, public services, and telecommunications. The company’s global presence and deep technical knowledge enable it to address the unique challenges faced by businesses in an increasingly digital world. Sopra Steria offers a comprehensive suite of services, including IT consulting, application development, infrastructure management, and cybersecurity solutions. Their key features include a client-centric approach, agile methodologies, and a focus on sustainable and ethical technology practices. The company targets large enterprises and public sector organizations that require tailored, scalable solutions to optimize their operations, enhance customer experiences, and drive digital innovation. By combining strategic advisory with cutting-edge technology, Sopra Steria empowers its clients to achieve long-term growth and resilience in competitive markets. Notable achievements include being recognized as a leader in multiple industry analyses and maintaining a strong commitment to corporate social responsibility. Sopra Steria’s unique value proposition lies in its ability to integrate deep domain expertise with advanced technological capabilities, ensuring that clients receive both strategic guidance and practical implementation support. The company’s market position is further strengthened by its collaborative culture and dedication to fostering long-term partnerships, making it a trusted advisor for organizations undergoing digital transformation.
