Loading...
SeniorFull-timePythonRustAWSGCPKubernetesMachine LearningGitAIDevOps
Salary Range
$99,450 - $134,550 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
The Inference team at Anthropic is responsible for building and maintaining the critical systems that serve Claude to millions of users worldwide. This role involves serving models via the industry's largest compute-agnostic inference deployments and managing the entire stack from intelligent request routing to fleet-wide orchestration across diverse AI accelerators.
Key Responsibilities
- →Design and implement intelligent routing algorithms that optimize request distribution
- →Autoscale compute fleet to match demand across production, research, and experimental workloads
- →Build production-grade deployment pipelines for releasing new models
- →Integrate new AI accelerator platforms
- →Contribute to new inference features
- →Support inference for new model architectures
- →Analyze observability data to tune performance
- →Manage multi-region deployments and geographic routing
Requirements
- ✓Significant software engineering experience, particularly with distributed systems
- ✓Results-oriented with a bias towards flexibility and impact
- ✓Willingness to pick up slack beyond job description
- ✓Desire to learn about machine learning systems and infrastructure
- ✓Thrive in environments where technical excellence drives both business results and research breakthroughs
- ✓Care about the societal impacts of your work
- ✓Bachelor's degree in a related field or equivalent experience
Benefits
- ★Competitive salary and optional equity donation matching
- ★Generous vacation and parental leave
- ★Flexible working hours
- ★Lovely office space for collaboration
Free to sign up. Takes 30 seconds.
