Senior Platform Engineer at Fiddler Ai

Our Purpose At Fiddler, we understand the implications of AI and the impact that it has on human lives. Our company was born with the mission of building trust into AI. The rise of Generative AI and Agents has unlocked generalized intelligence but also widened the risk aperture and made it harder to ensure that AI applications are working well. Fiddler enables organizations to get ahead of these issues by helping deploy trustworthy, and transparent AI solutions.  Fiddler partners with AI-first organizations to help build a long-term framework for responsible AI practices, which, in turn, builds trust with their user base. AI Engineers, Data Science, and business teams use Fiddler AI to monitor, evaluate, secure, analyze, and improve their AI solutions to drive better outcomes. Our platform enables engineering teams and business stakeholders alike to understand the "what", “why”, and "how" behind AI outcomes.   Our Founders Fiddler AI is founded by Krishna Gade (engineering leader at Facebook, Pinterest, Twitter, and Microsoft) and Amit Paka (product leader at Microsoft, Samsung, Paypal and two-time founder). We are backed by Insight Partners, Lightspeed Venture Partners, and Lux Capital.  Why Join Us Our team is motivated to help build trust into AI to enable society harness the power of AI. Joining us means you get to make an impact by ensuring that AI applications at production scale across industries have operational transparency and security.  We are an early-stage startup and have a rapidly growing team of intelligent and empathetic doers, thinkers, creators, builders, and everyone in between. The AI and ML industry has a rapid pace of innovation and the learning opportunities here are monumental. This is your chance to be a trailblazer.   Fiddler is recognized as a pioneer in the field of AI Observability and has received numerous accolades, including:  2022 a16z Data50 list, 2021 CB Insights AI 100 most promising startups, 2020 WEF Technology Pioneer, 2020 Forbes AI 50 most promising startups of 2020, and a 2019 Gartner Cool Vendor in Enterprise AI Governance and Ethical Response. By joining our brilliant (at least we think so) team, you will help pave the way in the AI Observability space. 👩🏽‍🚀 THE MISSION Platform Engineering at FiddlerAI is the engine that drives product velocity and customer success. We design and deliver the self-service tools and infrastructure that empower teams to innovate safely and at scale. By standardizing systems and reducing friction, we help every engineer focus on what matters most, building exceptional products that perform seamlessly for our customers. 🪐 ABOUT THE TEAM Our Platform Engineering team is a group of builders who make hard things look easy. They design and maintain the systems that keep Fiddler running smoothly; quietly holding the universe together with code, caffeine, and collaboration. Spread across time zones but united in purpose, this crew thrives on solving real problems, sharing what they learn, and jumping in to help wherever they’re needed. They bring brains, grit, and a healthy sense of humor to everything they do. They’re the kind of teammates who fix the issue, explain how they did it, and still show up to celebrate the win with everyone else. Platform Engineering doesn’t just keep the lights on, we’re busy designing better ones. If you like working on problems that haven’t been solved before, you’ll thrive here. Fiddler’s backend is where GenAI observability becomes real, from designing authorization layers for enterprise-scale AI systems to pioneering MCP authorization patterns. The systems you build will directly determine how companies trust and monitor their AI in production. 🚀 WHAT YOU’LL DO - Deliver a production-ready auth layer for GenAI workloads — Ship OAuth, machine-to-machine (M2M) authorization, and an LLM/MCP authorization layer that secures how enterprises connect agentic applications to Fiddler at scale. - Launch GenAI-specific alerting capabilities — Deliver new alert types that detect quality, safety, and performance issues in LLM applications, with notification integrations (PagerDuty, webhooks) and the APIs to configure them. - Ship backend features end-to-end — Own features from API design through async processing (Kafka, Celery) to production rollout across Fiddler's microservices — including monitoring, ingestion, and LLM evaluation workflows. - Keep services reliable and observable — Maintain SLOs, instrument with Prometheus/OpenTelemetry, and participate in on-call. When things break, you fix them. 🎯 WHAT WE’RE LOOKING FOR - 6+ years of experience building and operating production backend systems - Strong proficiency in Python; experience with Flask or similar web frameworks - Experience designing and maintaining RESTful APIs at scale; versioning, pagination, error handling, backward compatibility - Hands-on experience with relational databases (PostgreSQL preferred) and ORMs (SQLAlchemy) - Experience with asynchronous/event-driven processing; Celery, Kafka, or similar message queue and streaming systems - Production operational experience: debugging live services, structured logging, metrics, on-call - Comfort with cloud infrastructure (AWS or GCP) and containerized deployments (Docker, Kubernetes) - BS/MS in Computer Science or equivalent practical experience NICE TO HAVE - Experience building authentication/authorization systems: OAuth 2.0, RBAC, ABAC, API key management, M2M auth - Experience with multi-tenant SaaS architectures and data isolation patterns - Familiarity with LLM application patterns: evaluation, guardrails, prompt management, tool-use authorization - Experience building alerting or notification systems (alert evaluation engines, delivery pipelines, PagerDuty/webhook integrations) - Familiarity with ClickHouse or other OLAP databases for analytics queries - Experience with schema migration tools (Alembic) and database evolution strategies - Contributions to open-source projects 🩺 BENEFITS & PERKS - Competitive pay + equity - Premium health, dental & vision - Retirement plan - Generous PTO - Annual health check - Paid parental leave - Team and company events and offsites (this year was Coorg Wilderness Resort) - Lunch provided for in-office days The posted range represents the expected salary range for this job requisition and does not include any other potential components of the compensation package and perks previously outlined. Ultimately, in determining pay, we'll consider your experience, leveling, location, and other job-related factors. Fiddler is proud to be an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. If you require special accommodations in order to complete the interviews or perform job duties, please inform the recruiter at the beginning of the process. Beware of job scam fraud. Our recruiters use @fiddler.ai email addresses exclusively. In the US, we do not conduct interviews via text or instant message, or ask for sensitive personal information such as bank account or social security numbers.