Software Engineer, Applied AI at Shepherd

Shepherd

San Francisco·1w ago

Mid LevelFull-timeTypeScriptReactNode.jsNext.jsRedisGraphQLMachine LearningAI

Salary Range

$102,000 - $138,000 /year

Estimated

This salary is estimated based on similar roles. The actual salary may vary.

About the Role

We are hiring a Software Engineer focused on Applied AI to build intelligent systems that directly power our underwriting and pricing engine. This role sits at the intersection of product engineering, AI infrastructure, and real-world insurance workflows.

Key Responsibilities

→Partner with product, engineering, underwriting, and data teams to identify high-leverage AI opportunities
→Design, build, and deploy LLM-powered features across underwriting, pricing, and internal tooling
→Develop AI agents and retrieval-augmented systems that extract structured insights from unstructured insurance data
→Build production-grade AI infrastructure for model serving, inference, evaluation, and monitoring
→Create internal AI tools that enable underwriters and operators to move faster with higher quality decisions
→Establish best practices for prompt engineering, evaluation frameworks, and model reliability
→Own AI features end-to-end from ideation to production

Requirements

✓Strong backend engineering experience building scalable APIs and distributed systems
✓Hands-on experience shipping AI-powered products into production
✓Familiarity with LLMs, RAG architectures, embeddings, and vector databases
✓Experience integrating AI systems into user-facing or workflow-driven applications
✓Comfort with cloud infrastructure and deploying AI workloads at scale
✓A product mindset and the ability to translate ambiguous business problems into concrete AI systems
✓At least 5+ years of working experience (preferably as a full-stack engineer) with a track record of delivering high-impact products