Machine Learning Engineering Manager, GAI Search Relevance - Moveworks at ServiceNow

Machine Learning Engineering Manager, GAI Search Relevance As the leader of a team of talented search relevance engineers, your objective will be to measure and improve the ranking and relevance of our  AI-powered enterprise search applications. Since these applications also leverage large language models (LLMs), you will also be responsible for measuring and improving RAG-based objectives such as summarization, groundedness of responses, and citation correctness and completeness. You will guide the team to drive end-to-end development of machine-learning models, including data synthesis, feature engineering, experiment design, evaluation and more. Your team will play a pivotal role in improving our search relevance in a systematic and methodical manner as we scale to new customers, new types of data and use-cases, and will ultimately be accountable for the ranking quality of all our enterprise search products.  Your team's ownership of search quality is crucial to the company's search product lines, with success measured by its enablement capabilities. You will enable your team members by facilitating  rapid iteration on model enhancements, allowing them to improve ML metrics with a clear understanding of performance tradeoffs and generalizability. You will be responsible for guiding the team's technical direction, managing project timelines, and ensuring the robustness, efficiency, and innovation of our machine learning based search systems. Your team will collaborate closely with search infrastructure and platform engineers, and partner with product, design, and customer success teams to jointly achieve business objectives. What You Will Do: • Team Leadership: • Recruit, hire, and mentor a high-performing team of machine learning engineers. • Maintain a “ranking and relevance” mindset in your team, developing a thought leadership on our long-term relevance roadmap. • Foster a collaborative and inclusive team culture, promoting knowledge sharing and continuous learning. • Set clear goals, provide regular feedback, and promote professional growth and development of team members. • Project Management: • Develop and manage project plans, timelines, and budgets for machine learning initiatives. • Ensure the successful execution of projects, from ideation and prototyping to production deployment. • Collaborate with cross-functional teams to define project requirements and priorities. • Technical Leadership: • Drive the technical vision and strategy. • Guide the integration and application of large language models (LLMs) and retrieval-augmented generation (RAG) techniques to enable modern, intelligent search experiences. • Oversee the research, development, and deployment of machine learning models and algorithms. • Stay current with the latest advancements in the field and ensure that our projects leverage cutting-edge technologies. • Quality and Performance: • Implement best practices for model development, data pipelines, and model evaluation. • Monitor and optimize the performance, scalability, and reliability of machine learning systems. • Ensure that our AI solutions meet high standards of accuracy and efficiency. • Stakeholder Communication: • Collaborate with leadership, product managers, customer success staff, and other teams to align machine learning initiatives with business goals. • Provide regular updates and reports on project status, challenges, and successes to stakeholders. • Communicate, collaborate, and build relationships with partner teams and peer teams to facilitate cross-functional projects