AI Platform Optimization Lead Engineer
Venugopal SallaUnited StatesLEADPosted 13d ago
AI Platform OptimizationCost Optimization & Reliability EngineeringConsumption ArchitectureLLM Gateways & Model RoutingToken Metering & Rate LimitsMLOps
About the Role
We are looking for an AI Platform Optimization Lead Engineer to join our team. This role focuses on optimizing AI platforms and ensuring cost efficiency and reliability.
Key Responsibilities
• Optimize AI platforms for performance and cost
• Implement consumption architecture and LLM gateways
• Manage token metering and rate limits
• Lead MLOps practices
Requirements
• Expertise in AI Platform Optimization
• Strong background in Cost Optimization & Reliability Engineering
• Experience with Consumption Architecture
• Knowledge of LLM Gateways & Model Routing
• Understanding of Token Metering & Rate Limits
• Proficiency in MLOps