Thinking Machines Lab
Research Engineer, Infrastructure, Inference
San Francisco
Stay score
odds of building a lasting career here
Sponsors, but it's cap-subject — you still face the weighted lottery (~61% per draw at Level IV). Good if you win; have a cap-exempt backup on your list.
Lottery odds assume a STEM candidate.
Personalize to your clock →Employer immigration record
from this employer's Department of Labor filings
Files H-1B transfers
Sourced from Department of Labor LCA, PERM and prevailing-wage disclosure data. Employer matching is by name, so figures may be split across an employer's legal entities. Absence of a filing means none appears in our copy of the data, not that none exists.
Community outcomes
No reports yet — be the first to help the next applicant.
About the role
- Your work will make inference faster, more cost-effective, more reliable, and more reproducible to enable our teams to focus on advancing model capabilities rather than managing bottlenecks.
- Our focus is on performant and efficient model inference both to power real-world applications and to accelerate research.
- This role is responsible for the infrastructure that ensures every experiment, evaluation, and deployment runs smoothly at scale.
Responsibilities
- Collaborate with research teams to enable high-performance inference for novel architectures.
- Design and implement new techniques, tools, and architectures that improve performance, latency, throughput, and efficiency.
- Optimize our codebase and compute fleet (e.g., GPUs) to fully utilize hardware FLOPs, bandwidth, and memory.
- Thrive in a highly collaborative environment involving many, different cross-functional partners and subject matter experts.
Requirements
- Bachelor's degree or equivalent experience in computer science, engineering, or similar.
- Experience with inference serving systems optimized for throughput and latency (e.g., SGLang, vLLM).
- Strong engineering skills, ability to contribute performant, maintainable code and debug in complex codebases
- Experience training or supporting large-scale language models with hundreds of billions of parameters or more.
Nice to have
- we encourage you to apply if you meet some but not all of these:
Compensation
- Depending on background, skills and experience, the expected annual salary range for this position is $350,000 - $475,000 USD.
Benefits
- Thinking Machines offers generous health, dental, and vision benefits, unlimited PTO, paid parental leave, and relocation support as needed.
- Understanding of deep learning frameworks (e.g., PyTorch, JAX) and their underlying system architectures.
Company info
- The mission of Thinking Machines is to build AI that extends human will and judgment.
Visa & Work Authorization
- We sponsor visas.
- While we can't guarantee success for every candidate or role, if you're the right fit, we're committed to working through the visa process together.
This listing is sourced directly from Thinking Machines Lab's careers page and normalized into a canonical job model.