Sail Biomedicines
Member of Technical Staff - Distributed Systems
San Francisco · Staff+
Sponsorship not specifiedDetected 65 days ago
Distributed SystemsMachine LearningLLMs
About the role
- Sail is the foundation of useful, agentic AI.
- Everyone working at Sail will become an expert; nothing less will do in our immensely competitive market.
- Distributed systems are not easy to one-shot; you'll always have to think carefully about testing correctness and edge cases.
Responsibilities
- Design and implement high-performance schedulers (admission control, queuing, priority, fairness, preemption, bin packing).
- Build global routing and traffic management (latency-aware dispatch, predictive autoscaling, failover strategies).
- Build deep observability: we want to trace every millisecond of our systems, and catch failures early enough that we can make things right before the customer even notices.
- Build the systems that make AI inference fast, reliable, and cost-efficient at global scale.
- You'll design the control plane that schedules a huge queue of tokens over a diverse fleet of machines, spread all over the world.
Nice to have
- This is the first step because we respect your time.
- Ask any question and get a definitive answer immediately.
- Meet the CTO, who will ask about your experience, and share as much technical detail about Sail as you want to hear.
- Come in to Sail's SF office for an interview day.
- Meet the whole team, then you'll have 3-4 hours to work on a problem that closely simulates the work we do daily.
- It's an objectively scored task, so you'll have immediate feedback on how well your code is working - just like we do in production!
- AI assistance is highly encouraged, and we'll provide a laptop with all the best tools set up.
- Finish with a short presentation describing your process, learnings, and results.
Benefits
- Bonus: experience with ML inference stacks (vLLM/SGLang), GPUs/accelerators.
Company info
- What we're looking for
- We are here to take a big swing at the most ambitious engineering challenge of our careers.
- We are serious about investing in anything that saves us time or energy.
Apply directly at Sail Biomedicines →Create a free account for alerts like thisView Sail Biomedicines immigration profile
This listing is sourced directly from Sail Biomedicines's careers page and normalized into a canonical job model.