Loading...
SeniorFull-timePythonAWSGCPKubernetesMachine LearningGitGoAIML
Salary Range
$132,600 - $179,400 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are looking for an Infrastructure Software Engineer to join Baseten, a company powering mission-critical inference for leading AI companies. You'll architect and lead development of our ML inference platform that powers production AI applications.
Key Responsibilities
- →Design and architect scalable infrastructure systems for our ML inference platform
- →Lead optimization of Kubernetes deployments for efficient, cost-effective model serving
- →Drive enhancements to our inference orchestration layer for complex model deployments
- →Define monitoring strategies for model performance, latency, and resource utilization
- →Develop advanced solutions for GPU capacity management and throughput optimization
- →Establish infrastructure automation standards to streamline ML deployment workflows
- →Partner with other engineers to translate complex inference requirements into technical solutions
- →Make critical architectural decisions balancing performance with system reliability
- →Lead technical discussions and mentor junior engineers on infrastructure best practices
- →Contribute to long-term technical strategy and infrastructure roadmap
Requirements
- ✓Bachelor's degree or higher in Computer Science or related field
- ✓5+ years experience building production infrastructure systems
- ✓Expert-level proficiency in Go, with Python experience a plus
- ✓Deep expertise with Kubernetes in production environments
- ✓Advanced understanding of distributed systems concepts and performance tuning
- ✓Proven experience designing observability systems
- ✓Track record of leading technical initiatives and mentoring engineers
- ✓Experience with ML/AI workloads and MLOps platforms highly valued
Free to sign up. Takes 30 seconds.
