Baseten
Product Manager, Inference Platform
San Francisco · Staff+
Sponsorship not specifiedDetected 111 days ago
Distributed SystemsCloud PlatformsKubernetesMachine LearningSparkLLMsProduct ManagementResearch
About the role
- Once a model is deployed, keeping it fast, reliable, and economical at scale is where production inference is won or lost.
- Your job is to make it 10x easier to reliably scale and serve AI models in production and set the market standard.
Responsibilities
- We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital.
- Join us and help build the platform engineers turn to to ship AI products.
- We're building the product function now, and you'd be one of the people who defines it.
- You'll own the surface that makes that happen: how deployments autoscale, how traffic is routed, how the system fails over, and how workloads scale across clusters and regions.
- You will build the release engine beneath safe rollouts - the traffic-shifting that powers canary/shadow/A/B, warm-ups, drain, and probes.
Requirements
- 8+ years in product management, including deep experience with infrastructure, distributed systems, or ML serving.
Nice to have
- You don't like getting technical.
- You're not interested in the foundational, sometimes unglamorous work of making AI systems reliable and scalable at the infrastructure level.
- You will push the cost/performance frontier for serving AI at scale - latency, throughput, uptime, and cost-efficiency, plus a measurable decline in MTTR through self-serve incident management.
Skills
- This space is largely still evolving - think Cloud Infrastructure in mid-2000s.
Compensation
- Competitive compensation, including meaningful equity.
Benefits
- Competitive compensation, including meaningful equity.
- 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
- Paid parental leave
- Fertility and family-building stipend through Carrot
- Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
- If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
Company info
- PMs at Baseten don't sit above engineers - you earn ownership by being technical, finding the truth in front of customers, building great cross-functional relationships, and just shipping great product experiences.
- You'll own these as products end to end - both how they work under the hood and how customers configure and observe them - and you'll help set and define the roadmap that infrastructure and product teams alike can build towards.
- At Baseten, we are committed to fostering a diverse and inclusive workplace.
- You prefer only strategy, UX, or writing great docs over doing whatever it takes to ship great products for customers.
Apply directly at Baseten →Create a free account for alerts like thisView Baseten immigration profile
This listing is sourced directly from Baseten's careers page and normalized into a canonical job model.