Loading...
SeniorFull-timePythonRustKubernetesData ScienceGitAI
Salary Range
$132,600 - $179,400 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are looking for an AI Engineer to join Ethos, a company making life insurance faster and easier for families. You will own the LLM + retrieval + context layer for several LLM-powered copilots across critical workflows including underwriting productivity, agent enablement, customer support, operations/compliance, and fraud.
Key Responsibilities
- →Implement production RAG: indexing, retrieval, hybrid search, reranking, query rewriting, grounding, citations
- →Develop Context Graph: entity resolution + linking + provenance; graph + vector retrieval
- →Handle LLM orchestration: tool/function calling, structured outputs, routing across model tiers, failure modes
- →Optimize GPU/inference cost: batching, caching/KV reuse, quantization, autoscaling
- →Ensure Safety + compliance: PII/PHI handling, redaction, audit logs, deterministic replay, hallucination mitigation
- →Manage LLMOps: eval harness, monitoring for quality/cost/drift
- →Design and ship the end-to-end pipeline
- →Improve quality and trust via evaluation, feedback loops
- →Partner with product, security, and domain teams
Requirements
- ✓7+ years building production systems
- ✓2+ years hands-on LLMs/RAG
- ✓Proven RAG experience with embeddings, vector DBs, hybrid search
- ✓Strong backend/distributed systems + observability
- ✓Track record shipping in high-stakes environments
- ✓Knowledge graph / entity resolution systems
- ✓GPU inference optimization experience
- ✓Regulated domain experience (insurance/fintech/healthcare)
