Inferact
Member of Technical Staff, Cloud Orchestration
San Francisco · Staff+
H1B sponsorship available$200k-$400kDetected 181 days ago
PythonGoRustAWSGCPAzureCloud PlatformsKubernetesTerraformHelmMachine LearningLogistics
About the role
- You'll ensure that vLLM deployments are observable, debuggable, and recoverable, turning operational complexity into infrastructure that just works.
Responsibilities
- You'll design the systems for cluster management, deployment automation, and production monitoring that enable teams worldwide to serve AI models without friction.
Requirements
- Bachelor's degree or equivalent experience in computer science, engineering, or similar.
- Strong experience with Kubernetes and container orchestration at scale.
- Experience designing and implementing custom Kubernetes operators.
- Proficiency in Python/Rust/Go and infrastructure-as-code tools (Terraform, Helm, etc).
- Experience managing GPU clusters and debugging hardware issues.
- Ability to work across cloud platforms (AWS, GCP, Azure) and on-premise infrastructure.
Nice to have
- Experience with ML-specific orchestration tools (Ray, Slurm).
- Knowledge of GPU scheduling, multi-tenancy, and resource optimization.
- Familiarity with vLLM deployment patterns and configuration.
- Track record of improving operational reliability for ML systems.
- Experience deploying inference systems on large-scale GPU (1,000+) clusters.
- Visa sponsorship: We sponsor visas on a case-by-case basis.
Compensation
- Depending on background, skills, and experience, the expected annual salary range for this position is $200,000 - $400,000 USD + equity.
Benefits
- Inferact offers generous health, dental, and vision benefits as well as 401(k) company match.
Company info
- Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster.
- Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware-a position that took years to build.
Visa & Work Authorization
- We sponsor visas on a case-by-case basis.
Apply directly at Inferact →Create a free account for alerts like thisView Inferact immigration profile
This listing is sourced directly from Inferact's careers page and normalized into a canonical job model.