Inferact

Inferact

Inference Engineering, Co-op

San Francisco · Intern · Internship

Sponsorship not specifiedDetected 38 days ago
PythonGoRustC++Node.jsDistributed SystemsAlgorithmsCloud PlatformsKubernetesTerraformHelmMachine LearningPyTorchLLMsLogisticsResearchCommunicationMentoring

Stay score

odds of building a lasting career here

37Risky
Cap-exempt (no lottery)0
Sponsors this role80
Entry-level history0
PERM / green-card track0
Lottery odds40
Fits your clock70

Thin sponsorship signal and lottery-bound. A low-probability bet with your clock running. Prioritize cap-exempt roles and proven entry-level sponsors first.

Lottery odds assume a STEM candidate.

Personalize to your clock →

Employer immigration record

from this employer's Department of Labor filings

Files H-1B transfers

3 transfer filings in the last year, covering 3 workers. Median labor-condition decision: 7 days. An employer that already files transfers is one that can take over an existing H-1B.

Sourced from Department of Labor LCA, PERM and prevailing-wage disclosure data. Employer matching is by name, so figures may be split across an employer's legal entities. Absence of a filing means none appears in our copy of the data, not that none exists.

Community outcomes

No reports yet — be the first to help the next applicant.

About the role

  • Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster.
  • We're looking for exceptional University of Waterloo co-op students who want to work on the systems that determine how fast, efficiently, and reliably frontier AI models run on frontier workloads at scale.
  • This is not a sandboxed internship project.

Responsibilities

  • You'll work alongside the creators and core maintainers of vLLM on work intended to ship into open source, production systems, or the tooling that supports both.
  • You will have a primary technical track, meaningful ownership, and mentorship from a small, senior team, with opportunities to collaborate across models, compilers, accelerators, networking, and distributed systems.
  • Build the distributed serving data plane that lets vLLM run across many GPUs and nodes.
  • Performance & Scale: Build the distributed serving data plane that lets vLLM run across many GPUs and nodes.

Requirements

  • Currently pursuing a bachelor's, master's, or PhD degree in computer science, engineering, mathematics, or a related technical field, and eligible for a University of Waterloo co-op work term.
  • Strong computer science fundamentals and the ability to learn from research papers, technical documentation, and complex systems code.
  • Evidence that you have built and debugged nontrivial software through coursework, research, a prior internship, open-source work, or an ambitious side project.

Nice to have

  • Hands-on experience with one or more relevant technologies such as PyTorch, vLLM, SGLang, TensorRT-LLM, CUDA, Triton, TileLang, ROCm/HIP, JAX/XLA, Pallas, Kubernetes, Helm, Terraform, Ray, or SLURM.
  • Experience with systems beyond a single local process or device, including multi-GPU, multi-node, research-cluster, high-throughput, or production-like workloads.
  • Contributed to open-source ML, systems, compiler, or infrastructure projects, especially vLLM or adjacent projects.
  • Built a research system, benchmark suite, compiler or kernel project, distributed service, or infrastructure tool that demonstrates unusual technical depth and initiative.
  • Worked across more than one layer of the stack and enjoy moving between algorithms, runtimes, systems, and hardware rather than staying inside a single abstraction.
  • Meet Inferact at Waterloo
  • Join us for our University of Waterloo Employer Information Session to meet the team, learn more about Inferact, and hear about the Inference Engineering Co-op opportunity.
  • Venue: Tatham Centre, Room 2218

Skills

  • Skills and Qualifications

Compensation

  • Competitive compensation based on the applicable co-op market and candidate background, plus a housing stipend for the duration of the co-op term.

Company info

  • About the Role We're looking for exceptional University of Waterloo co-op students who want to work on the systems that determine how fast, efficiently, and reliably frontier AI models run on frontier workloads at scale.
  • Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware, a position that took years to build.
Apply directly at Inferact →Create a free account for alerts like thisView Inferact immigration profile

This listing is sourced directly from Inferact's careers page and normalized into a canonical job model.