Principal Engineer, AI Model LifeCycle at Crusoe

Crusoe

San Francisco, CA - US·3h ago

LeadFull-timePythonGolangMachine LearningPyTorchAIML

Salary Range

$153,000 - $207,000 /year

Estimated

This salary is estimated based on similar roles. The actual salary may vary.

About the Role

The Principal Software Engineer for the Model LifeCycle team will play a crucial role in building a comprehensive managed platform for the entire application development lifecycle, with a specific focus on leveraging Machine Learning models, including Large Language Models (LLMs).

Key Responsibilities

→Manage fine-tuning systems for large foundation models (SFT, PEFT, LoRA, adapters), including multi-node orchestration, checkpointing, failure recovery, and cost-efficient scaling.
→Implement and maintain end-to-end training pipelines for Large Language Models.
→Develop distillation and reinforcement learning pipelines (e.g., preference optimization, policy optimization, reward modeling).
→Build agent execution infrastructure.
→Manage dataset, model, and experiment management: versioning, lineage, evaluation, and reproducible fine-tuning at scale.
→Work closely with product, business, and platform teams to shape the core abstractions and APIs of the system.
→Influence long-term architectural decisions around training runtimes, scheduling, storage, and model lifecycle management.
→Contribute to and engage with the open-source LLM ecosystem.
→Design and build core systems from first principles.

Requirements

✓Advanced degree in Computer Science, Engineering, or a related field.
✓10-15+ years of industry experience driving impactful projects in the AI Space.
✓Proven track record of delivering early-stage projects under tight deadlines.
✓Expertise in using cloud-based services, such as elastic compute, object storage, virtual private networks, managed database, etc.
✓Experience in Generative AI (Large Language Models, Multimodal).
✓Deep experience with AI infrastructure, including training, inference.