Jobs → Data & Analytics → Data Engineer

About the Role We are looking for a Data Engineer to lead the design and delivery of secure, scalable and cost-effective data solutions across on-premises and cloud platforms. Key Responsibilities • Provide technical leadership across complex data engineering initiatives • Design batch and near-real-time pipelines • Integrate data into trusted data assets for reporting, analytics and downstream applications • Establish reusable engineering patterns • Improve platform reliability • Mentor other data engineers Requirements • Seven or more years of experience in data engineering, data warehousing or a related field • Strong experience designing and delivering end-to-end data engineering solutions • Advanced SQL and Python, with practical experience using Spark or equivalent distributed processing technologies • At least two years of experience designing and delivering solutions with Azure Databricks • Experience delivering cloud-based analytics or reporting pipelines • Strong experience with batch processing and practical exposure to near-real-time or streaming solutions • Experience with data profiling, source-to-target mapping, ETL/ELT development, testing, implementation and SQL optimisation • Experience with orchestration tools such as Airflow, Control-M or equivalent • Experience applying CI/CD, version control, automated testing and release-management practices • Experience designing solutions for structured and unstructured data, including JSON, XML and Avro • Demonstrated ability to provide technical leadership, mentor engineers and make sound engineering decisions