Loading...
Mid LevelFull-timePythonAWSMachine LearningData ScienceAIML
Salary Range
$60,563 - $81,938 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are looking for an Evaluation Engineer to join Perplexity, where you will build specialized evaluation systems to improve answer quality across our products. This role involves creating automated pipelines and methods to assess the quality of LLM-based answers and search results.
Key Responsibilities
- →Architect and maintain automated evaluation pipelines to assess answer quality across Perplexity's products
- →Design evaluation sets and methods to measure the impact of tool calls on final answer quality
- →Develop VLM-based solutions to evaluate how answers render visually across different platforms
- →Review public benchmarks and academic evaluations for applicability to Perplexity products
- →Collaborate with technical leadership to measure and improve Answer Quality
Requirements
- ✓PhD or MS in a technical field or equivalent experience
- ✓4+ years of experience in data science or machine learning
- ✓Strong proficiency in Python and SQL
- ✓Experience building within a modern cloud data stack, specifically AWS and Databricks
- ✓Comfortable with agentic coding workflows and using AI-assisted development tools
