Loading...
Mid LevelFull-timeAIML
Salary Range
$110,500 - $149,500 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are looking for a Product Manager to join the ML/AI Platform team at Spotify. This role focuses on overseeing AI Observability and Evaluation, helping various groups build, deliver, and run ML and AI-enabled experiences at scale.
Key Responsibilities
- →Own the product roadmap for Spotify’s AI observability capabilities across instrumentation, data contracts, and debugging workflows.
- →Collaborate with stakeholders to develop the roadmap for Spotify’s AI/Agentic evaluation capabilities via LLM-as-judges and other approaches.
- →Build golden path instrumentation defaults (SDKs/libraries/templates) that make LLM workloads observable by default.
- →Partner with engineering to deliver root-cause workflows across LLM chains/agents.
- →Drive adoption with internal teams through discovery, pilots, documentation, and ongoing enablement.
- →Define and track success metrics (coverage, time-to-first-trace, regressions caught pre-prod, MTTR, cost anomalies detected early).
- →Partner with Privacy/Security to establish safe logging and retention guidance.
Requirements
- ✓2+ years of experience as a Product Manager, Technical Product Manager, or equivalent product ownership role.
- ✓Familiar with ML and AI development flows, and comfortable reasoning about LLM application patterns.
- ✓Aware of LLM evaluation approaches (golden datasets, regression testing, human-in-the-loop review, LLM-as-a-judge).
- ✓Comfortable partnering with engineers on technical tradeoffs and system design.
- ✓Strong product fundamentals: discovery, prioritization, roadmap communication, and stakeholder alignment.
- ✓Metrics-oriented and pragmatic; you can define outcomes and iterate based on evidence.
Free to sign up. Takes 30 seconds.
