Inferact

Member of Technical Staff, Inference

San Francisco · Staff+

H1B sponsorship available$200k-$400kDetected 33 days ago

PythonAlgorithmsMachine LearningPyTorchNLPLLMsLogisticsResearch

About the role

We're looking for an inference runtime engineer to push the boundaries of what's possible in LLM and diffusion model serving.
Architectures shift: mixture-of-experts, multimodal, agentic.
Every breakthrough demands innovations on the inference engine itself.

Bachelor's degree or equivalent experience in computer science, engineering, or similar.
Strong programming skills in Python with experience in PyTorch internals.
Experience with LLM inference systems (vLLM, TensorRT-LLM, SGLang, TGI).
Demonstrate the ability to contribute performant and maintainable code and debug in complex ML codebases.

Familiarity with RL frameworks and algorithms for LLMs.
Experience with multimodal inference (audio/image/video/text).
Contributions to open-source ML or system infrastructure projects.
Implemented core features in vLLM or other inference engine projects.
Contributed to vLLM integrations (verl, OpenRLHF, Unsloth, LlamaFactory, etc).
Written widely-shared technical blogs or side projects on vLLM or LLM inference.
Visa sponsorship: We sponsor visas on a case-by-case basis.

Depending on background, skills, and experience, the expected annual salary range for this position is $200,000 - $400,000 USD + equity.

Inferact offers generous health, dental, and vision benefits as well as 401(k) company match.

Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster.
Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware-a position that took years to build.

This listing is sourced directly from Inferact's careers page and normalized into a canonical job model.