Loading...
Mid LevelFull-timeTypeScriptPythonNode.jsNext.jsData ScienceGoAI
Salary Range
$76,500 - $103,500 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are looking for an AI Engineer to join Ruby Labs and shape our AI infrastructure. You'll work with modern technologies to drive production-ready LLM experiences and make data-driven decisions around model performance.
Key Responsibilities
- →Design complex prompt templates with conditional logic to maximize generation quality
- →Implement various response schemes to ensure predictable AI outputs
- →Build evaluation pipelines and use Langfuse to score response quality in real time
- →Perform deep debugging of complex LLM chains to identify bottlenecks
- →Run systematic experiments across different models and analyze results
- →Make deployment decisions based on quantitative benchmarks
- →Develop scoring systems to analyze problem-solution chains
- →Regularly evaluate model performance and perform fine-tuning when needed
Requirements
- ✓Deep knowledge of Node.js and Next.js stack
- ✓Proven experience in building dynamic prompts
- ✓Experience working with unified APIs and managing rate limits
- ✓Understanding of LLM observability principles
- ✓Experience with evaluation frameworks
- ✓Ability to transform generation logs into actionable metrics
- ✓Focus on continuous product improvement through feedback loops
