Data Engineer at SmithsGroup2

Job Description: Responsible for designing and building the ingestion and transformation of data pipelines and maintain optimal data pipeline processes for the Smiths Group. Maintain the ingestion framework processes of data, apply security and governance of data as well as modelling to ensue data preparation is fit for purpose and protected at all times.   Build the process required for optimal extraction, transformation, and loading of data from a wide variety of data sources. Build analytics models that utilise the data pipeline to provide actionable insights into customer needs, operational efficiency and other key business performance metrics. Assemble large, complex data sets that meet functional / non-functional business requirements. Build AI/ML models for varied use cases across Smiths. Work closely and proactively with Smiths teams and key business partners for Delivery, Transition and Support tasks Work with data owners, and design teams to assist with data-related technical issues and support their data infrastructure needs. Duties & Responsibilities: • Identify, design, and implement internal process improvements: automating manual processes, optimising data delivery • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader • Work with data and analytics experts to strive for greater functionality in our data systems • Optimize existing ETL process and employing a verity of data ingestion and data preparations tools, or write code such as Scala Python, and Java • Manage & Maintain CDC and Data Catalogue processes • Creating and maintaining analytical extracts • Identify Sensitive and confidential datasets and use appropriate framework methods to protect the data • Monitoring of key azure functions and critical jobs as well as components within the Smiths Data Lake • Assigning and provisioning Azure resources within the Smiths Data Subscription • Raise Microsoft and Azure related tickets using Microsoft support processes • Work closely with Information Architect to ensure data curation remains line with Enterprise Data Model Standards. • Continue to maintain existing Oracle and SQL services in BIS data centers and support to keep lights on. • Keep our data separated and secure.