Loading...
ManagerFull-timeRustAWSMachine LearningPyTorchAIML
Salary Range
$163,200 - $220,800 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are looking for an engineering leader to build and lead the world's leading AI systems. This role involves optimizing the world's largest and most capable AI models for high-volume, low-latency, and high-availability production and research environments.
Key Responsibilities
- →Lead a team of engineers specializing in distributed systems and model architecture
- →Collaborate with machine learning researchers, engineers, and product managers to bring technologies into production
- →Work in an outcome-oriented environment across all stack layers, from infrastructure to performance tuning
- →Introduce new techniques, tools, and architecture to improve model inference stack performance
- →Build tools for visibility into bottlenecks and design solutions for priority issues
- →Optimize code and GPU fleet to maximize hardware utilization
Requirements
- ✓Understanding of modern ML architectures and optimization for inference
- ✓End-to-end problem ownership with a willingness to acquire necessary knowledge
- ✓At least 15 years of professional software engineering experience
- ✓Familiarity with PyTorch, NVidia GPUs, and related software stacks (NCCL, CUDA)
- ✓Experience with HPC technologies like InfiniBand, MPI, NVLink
- ✓Experience with production distributed systems, with a preference for performance-critical systems
- ✓History of rebuilding or refactoring production systems due to scale increases
- ✓Self-directed with a focus on identifying and solving important problems
- ✓Humble attitude with a desire to help colleagues and contribute to team success
Free to sign up. Takes 30 seconds.
