Inworld AI
Staff / Principal Machine Learning Engineer, Serving - USA
Mountain View, California, USA · Principal · Full-time
Sponsorship not specified$270k-$500kDetected 106 days ago
C++Node.jsDistributed SystemsKubernetesMachine LearningAgentic AILoad BalancingResearchCollaboration
About the role
- Today our models are the #1 ranked realtime voice models in the world.
- They are used to power the largest consumer-facing AI applications available, across categories like health, fitness, learning, therapy, companions, customer experience and media; representing 100s of millions of end users.
- Our work spans areas like research and development of state-of-the-art models, optimizing realtime inference, and creating best-in-class APIs and products that allow developers to engage their users.
Responsibilities
- You can take a model from the research team, containerize it, optimize its serving, and ensure it runs reliably in production.
- Background. PhD in CS, Physics, Math, or equivalent practical experience building backend or ML systems.
- You don't need a roadmap to start walking; you're comfortable picking a direction and building the map as you go.
Requirements
- Hands-on experience with quantization, distillation, caching strategies, continuous batching, paged attention, and speculative decoding.
- Proficiency in C++, CUDA, Rust, or highly optimized Python.
- Experience with Kubernetes, Ray, custom load balancing, multi-GPU/multi-node inference, and reliably handling thousands of concurrent connections.
Compensation
- The base salary range for this full-time position is $270,000 - $500,000+ bonus + equity + benefits.
Apply directly at Inworld AI →Create a free account for alerts like thisView Inworld AI immigration profile
This listing is sourced directly from Inworld AI's careers page and normalized into a canonical job model.