Baseten
Capacity Manager, Operations
San Francisco · Senior
Sponsorship not specifiedDetected 42 days ago
Machine LearningSparkSupply ChainEmbedded SystemsResearchCommunicationCollaboration
Stay score
odds of building a lasting career here
40Risky
Cap-exempt (no lottery)0
Sponsors this role90
Entry-level history0
PERM / green-card track0
Lottery odds40
Fits your clock70
Thin sponsorship signal and lottery-bound. A low-probability bet with your clock running. Prioritize cap-exempt roles and proven entry-level sponsors first.
Lottery odds assume a STEM candidate.
Personalize to your clock →Community outcomes
No reports yet — be the first to help the next applicant.
About the role
- GPU fleet lifecycle, health, observability, utilization monitoring, and remediation across our neocloud and bare metal environments.
- We contract for a fixed amount of compute capacity.
- GPUs drift from healthy to unhealthy over time, and this role minimizes that downtime to keep the maximum number of GPUs healthy at any given moment.
Responsibilities
- Drive suppliers to keep the maximum amount of the GPU fleet online and healthy.
- Maintain a live reconciliation of contracted vs. provisioned vs. healthy vs. utilized capacity, broken out by supplier and by cluster maximizing the number of healthy GPUs.
- SLA monitoring, credit claims, and remedy enforcement: track SLA performance against contract terms, file and pursue credit claims, and drive remediation plans when suppliers fall short.
- Drive internal communications where suppliers need to perform maintenance to ensure all Baseten stakeholders are aware of activities that impact availability.
- We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital.
- Join us and help build the platform engineers turn to ship AI products.
- You'll drive execution through clear processes, metrics, reporting, vendor coordination, and cross-functional alignment.
Requirements
- 5 to 10+ years within infrastructure working within the compute lifecycle to maximize functional compute, ideally in a hyperscale, cloud, or large-scale compute environment.
Nice to have
- Experience at a hyperscaler, neo cloud provider, or AI infrastructure company
- Familiarity with GPU hardware lifecycles (NVIDIA H100/H200/GB200 class systems), power/thermal constraints, and supply chain dynamics for compute.
- Experience running formal supplier corrective actions.
Compensation
- Competitive compensation, including meaningful equity
Benefits
- Competitive compensation, including meaningful equity
- (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
- If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
- Supplier-attributed fleet health accountability: own replacement SLAs, mean time to repair (MTTR), and RMA cycle times for every in-scope supplier.
- By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production.
Company info
- At Baseten, we are committed to fostering a diverse and inclusive workplace.
- We're looking for a hands-on Operations Manager to own the operational and analytical supply side of our GPU fleet.
Apply directly at Baseten →Create a free account for alerts like thisView Baseten immigration profile
This listing is sourced directly from Baseten's careers page and normalized into a canonical job model.