Jobs → Data & Analytics → Big Data Architect

About the Role We are looking for an experienced Big Data Architect with strong expertise in Azure and PySpark to design and drive modern, scalable data platforms and data-intensive applications. Key Responsibilities • Design and implement scalable data solutions and data platforms • Design real-time streaming architectures • Design data solutions using Agile practices • Design for testability, deployability and releaseability • Develop data products and data-intensive applications • Perform rapid prototyping and data modeling • Create scalable and evolving data architectures • Support Continuous Delivery / CI-CD pipelines • Build in Quality and Security from the beginning • Define and maintain Non-Functional Requirements (NFRs) • Contribute to architectural Runway and architecture evolution • Work with multiple stakeholders across engineering, product and business teams • Work independently across multiple projects in a fast-paced environment Requirements • 8–15 years of experience in the field • Minimum 4-5+ years of architect experience • Strong Microsoft Azure experience • Strong hands-on PySpark experience • Big Data / Data Architecture experience • Experience with Azure Databricks • Experience designing scalable data solutions and data platforms • Experience with real-time streaming architectures • Experience with Apache Kafka or equivalent streaming technologies • Experience with Data Mesh architecture • Experience with Azure Data Lake Storage / ADLS • Experience with Azure Synapse • Experience with Azure Data Factory • Experience with Kubernetes / K8s • Experience with DataOps • Experience with CI/CD data pipelines • Experience with Data modeling • Experience with SQL / Enterprise Data Warehouse • Experience with Power BI / Reporting & Analytics • Experience with Apache NiFi • Exposure to AWS is an advantage, but Azure is the primary requirement • Experience with recognised architecture frameworks or standards such as TOGAF, Zachman Architecture Framework, SAFe / Agile architecture practices