Loading...
SeniorFull-timeRustKubernetesAIML
Salary Range
$86,190 - $116,610 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are looking for a ML Infrastructure Engineer to join Cohere, a company focused on scaling intelligence to serve humanity. This role involves building the next generation of agentic AI infrastructure, working at the intersection of ML systems, distributed infrastructure, and developer experience.
Key Responsibilities
- →Develop secure execution environments for agent-generated code
- →Implement identity, authentication, and trust boundaries for agents
- →Create model routing and orchestration systems across different model types and environments
- →Manage rate limiting, quotas, and resource allocation for agent workflows
- →Build state management, memory, and filesystem abstractions for agents
- →Turn emerging ML research ideas into production-ready infrastructure
- →Build core platform capabilities for execution, storage, and state management
- →Prototype and evaluate new technologies for potential production use
- →Partner with research teams to shape infrastructure based on future agent system needs
Requirements
- ✓Experience building production ML infrastructure with strong systems fundamentals
- ✓Hands-on work with agentic systems, multi-agent workflows, or agent development frameworks
- ✓Familiarity with model routing and LLM provider frameworks across different model types and environments
- ✓Experience with scalable, fault-tolerant distributed systems and Kubernetes
- ✓A track record of quickly moving prototypes into production
Benefits
- ★An open and inclusive culture and work environment
- ★Work closely with a team on the cutting edge of AI research
- ★Weekly lunch stipend, in-office lunches & snacks
- ★Full health and dental benefits, including a separate budget for mental health
- ★100% Parental Leave top-up for up to 6 months
- ★Personal enrichment benefits towards arts and culture, fitness and well-being
- ★Remote-flexible work arrangement with offices in multiple cities
- ★6 weeks of vacation (30 working days)
Free to sign up. Takes 30 seconds.
