Sesame
ML Model Serving Engineer
San Francisco · Contract
Sponsorship not specifiedDetected 494 days ago
AWSGCPCloud PlatformsKubernetesMachine LearningPyTorchLLMs
About the role
- Our team brings together founders from Oculus and Ubiquity6, alongside proven leaders from Meta, Google, and Apple, with deep expertise spanning hardware and software.
- Join us in shaping a future where computers truly come alive.
- Experience working on high-performance server systems-you'd be just as comfortable with the internals of VLLM as you would with a complex PyTorch codebase. - Significant performance engineering experience; ex.
Responsibilities
- Partner with ML infrastructure and training engineers to build a fast, cost-effective, accurate, and reliable serving layer to power a new consumer product category.
- Sesame believes in a future where computers are lifelike - with the ability to see, hear, and collaborate with us in ways that feel natural and human.
Requirements
- Significant systems programming experience
- Experience working on high-performance server systems-you'd be just as comfortable with the internals of VLLM as you would with a complex PyTorch codebase.
- Significant performance engineering experience
Nice to have
- Familiarity with high-performance LLM serving
- ex. experience with VLLM, SGlang deployment, and internals.
- Experience with a public cloud platform such as GCP, AWS, or Azure.
- Experience deploying and scaling inference workloads in the cloud using Kubernetes, Ray, etc.
- You like to ship and have a track record of leading complex multi-month projects without assistance.
- You're excited to learn new things and work in a multitude of roles.
- Sesame is committed to a workplace where everyone feels valued, respected, and empowered.
- We welcome all qualified applicants, embracing diversity in race, gender, identity, orientation, ability, and more.
Compensation
- 401 (k) max employer match: 3.5% of compensation
Benefits
- 100% employer-paid health, vision, and dental benefits for you and your dependents
- Unlimited PTO and sick time
- Flexible spending account with employer matching up to $1,650/year (medical FSA)
- Opportunity to share in the company's success with competitive stock options
- Benefits do not apply to contingent/contract workers.
- With this vision, we're designing a new kind of computer, focused on making voice agents part of our daily lives.
- Turbocharge our serving layer, consisting of a variety of LLM, speech, and vision models.
This listing is sourced directly from Sesame's careers page and normalized into a canonical job model.