The project
About the Role
We are seeking a senior Data Architect to design and build an Enterprise Data Warehouse / Lakehouse platform for the supply chain domain from the ground up. This role requires deep expertise in Databricks Lakehouse, strong AI/ML capabilities, and a proven ability to leverage AI as an accelerator across the Software Development Life Cycle (SDLC).
Key Responsibilities
• Define the end-to-end vision, architecture, and roadmap for the enterprise data platform.
• Design and implement a greenfield EDW / Lakehouse architecture (Bronze, Silver, Gold layers).
• Build scalable data ingestion frameworks integrating ERP, WMS, TMS, MES, procurement, and logistics systems.
• Develop pipelines using PySpark, Spark SQL, Delta Live Tables (DLT), and orchestrate with Databricks Workflows.
• Implement data governance, lineage, and security using Unity Catalog.
• Embed AI/ML and GenAI capabilities such as LLM-driven schema mapping and natural-language BI solutions.
• Drive AI-accelerated SDLC delivery using copilots, agents, and automation tools.
• Establish standards for data quality, monitoring, and reliability.
Requirements
• 12+ years in Data Engineering / Architecture
• Hands-on experience with Databricks Lakehouse Platform
• Expertise in PySpark, Spark SQL, Delta Lake & Delta Live Tables, Databricks Workflows
• Experience with Unity Catalog (governance, lineage, access control)
• Strong knowledge of Dimensional Modeling & Data Vault, Medallion Architecture, Data Product Design
• Experience with CI/CD & IaC (Terraform / Databricks Asset Bundles)
• Solid exposure to AI/ML technologies: GenAI, LLMs, RAG, Vector Search, MLOps & Feature Stores
• Proven experience using AI tools (Copilots/Agents) to accelerate SDLC
