Senior Engineering Manager, ML Platform at Whatnot

About the Role

We are looking for a hands-on builder to lead the development and scaling of core infrastructure that powers machine learning and self-hosted large language model applications at Whatnot. You'll work with machine learning scientists to bring cutting-edge models into production and unlock new product experiences.

Key Responsibilities

• →Own the infrastructure powering AI and ML models across critical business surfaces
• →Guide the prototyping, deployment, and productionization of novel ML architectures
• →Design and scale inference infrastructure capable of serving large models with low latency
• →Oversee real-time feature pipelines that feed both online and offline stores
• →Lead the development of distributed training and inference pipelines leveraging GPUs
• →Optimize system performance by managing resource utilization and developing feature caching strategies
• →Build abstractions, APIs, and developer tools to simplify development of near-realtime features
• →Roll out better ergonomics around model training and deployment