Loading...
LeadFull-timePythonGolangKubernetesREST APIMicroservicesCI/CDAIAPIML
Salary Range
$153,000 - $207,000 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are looking for a Principal Software Engineer to join the Managed AI team at Crusoe. This role involves shaping the architecture and scalability of our next-generation AI inference platform, leading the design and implementation of core systems for AI services, and building infrastructure capable of handling millions of API requests per second.
Key Responsibilities
- →Lead the design and implementation of core AI services, including resilient fault-tolerant queues, model catalogs, and scheduling mechanisms optimized for cost and performance.
- →Build and scale infrastructure to handle millions of API requests per second.
- →Optimize AI inference performance on GPU-based systems.
- →Collaborate closely with product management, business strategy, and other engineering teams.
- →Influence the long-term vision and architectural decisions of the AI platform.
Requirements
- ✓Advanced degree in Computer Science, Engineering, or a related field.
- ✓Demonstrable experience in distributed systems design and implementation.
- ✓Proven track record of delivering early-stage projects under tight deadlines.
- ✓Expertise in using cloud-based services, such as elastic compute, object storage, virtual private networks, managed database, etc.
- ✓Experience in Generative AI (Large Language Models, Multimodal).
- ✓Familiarity with AI infrastructure, including training, inference, and ETL pipelines.
- ✓Experience with container runtimes (e.g., Kubernetes) and microservices architectures.
- ✓Experience using REST APIs and common communication protocols, such as gRPC.
- ✓Demonstrated experience in the software development cycle and familiarity with CI/CD tools.
Benefits
- ★Industry competitive pay
- ★Restricted Stock Units in a fast-growing, well-funded technology company
- ★Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
- ★Employer contributions to HSA accounts
- ★Paid Parental Leave
- ★Paid life insurance, short-term and long-term disability
- ★Teladoc
- ★401(k) with a 100% match up to 4% of salary
- ★Generous paid time off and holiday schedule
- ★Cell phone reimbursement
- ★Tuition reimbursement
- ★Subscription to the Calm app
- ★MetLife Legal
- ★Company paid Commuter FSA benefit of $300 per month
