Inferact
Member of Technical Staff, CI/CD Infrastructure
San Francisco · Staff+
H1B sponsorship available$200k-$400kDetected 13 days ago
PythonBashGitDockerKubernetesCI/CDGitHub ActionsLinuxMachine LearningLogistics
About the role
- vLLM is growing at a fast pace, and every bit of that growth lands on the CI system.
- More models, more hardware, more contributors, more ways for things to break.
- Your job is to advance the CI system so it scales with vLLM's momentum and unlocks faster development for everyone.
Responsibilities
- Maintain and scale the compute infrastructure that powers CI, release, performance benchmark, accuracy evaluation for vLLM project, across a wide range of models and accelerators including H100/H200, (G)B200/300, AMD MI325/355X, TPU, Intel Gaudi, etc..
- Build out tooling that helps 3,000+ vLLM contributors move fast
Requirements
- Strong experience with Docker, Kubernetes, and containerized build or test environments.
Nice to have
- Setting up infrastructure for ML, inference, CUDA, ROCm, or accelerator-heavy workloads.
- Running Buildkite at scale, including agents, queues, dynamic pipelines, test sharding, caching, and artifact management.
- Operating Kubernetes clusters for CI, batch jobs, test execution, or internal developer infrastructure.
- Managing CI/CD in large open-source project
Compensation
- Depending on background, skills, and experience, the expected annual salary range for this position is $200,000 - $400,000 USD + equity.
Benefits
- Inferact offers generous health, dental, and vision benefits as well as 401(k) company match.
Company info
- Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference efficient and faster.
- Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware-a position that took years to build.
Visa & Work Authorization
- We sponsor visas on a case-by-case basis.
Apply directly at Inferact →Create a free account for alerts like thisView Inferact immigration profile
This listing is sourced directly from Inferact's careers page and normalized into a canonical job model.