Loading...
SeniorFull-timePythonAzureCI/CDML
Salary Range
$62,985 - $85,215 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are looking for a Lead Data Architect to join the Data team at ArcelorMittal in Fos-sur-Mer. Your main objective will be to design, build, and ensure the reliability of a robust Cloud Data platform while developing the technical team.
Key Responsibilities
- βDefine and implement Cloud architecture (Azure/Databricks) for data storage, processing, and exposure via a Medallion structure.
- βLead the industrialization of flows between NiFi (on-prem) and ADLS, and develop complex data processing under Python/Spark.
- βEnsure schema management, data quality, and publication via Unity Catalog, while optimizing Cloud costs and performance.
- βGuarantee team skill development through best practice sharing, technical documentation, and active participation in brainstorming sessions.
- βOptionally contribute to the strategy around industrial generative AI on Databricks.
Requirements
- βMinimum 5 years of experience in a similar position.
- βExpertise in Cloud architecture (Azure/Databricks) and Medallion structure.
- βStrong skills in Python, SQL, PySpark, and Spark.
- βExperience with Apache NiFi, Unity Catalog, CI/CD, and Data Governance.
- βAbility to mentor and lead a multidisciplinary team.
