Baseten

Software Engineer- BIS (Baseten Inference Stack)

San Francisco

Sponsorship not specifiedDetected 51 days ago

Distributed SystemsKubernetesCI/CDPlatform EngineeringMachine LearningSparkLLMsResearchCommunicationCollaboration

About the role

We operate at the intersection of distributed systems, model performance, infrastructure, and developer experience.
We enable customers to deploy and operate cutting-edge LLM models with industry-leading performance, scalability, reliability, and ease of use.
This is an ideal role for engineers who enjoy owning systems in production, solving hard integration problems, and making complex infrastructure simple and reliable for users.

Develop infrastructure and orchestration systems for deploying and managing large-scale distributed LLM inference
Build platform capabilities related to routing, autoscaling, scheduling, observability, and runtime management
Own projects end-to-end: from architecture and implementation through deployment, monitoring, and iteration based on customer feedback
We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital.
Join us and help build the platform engineers turn to to ship AI products.

Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, or a related field
Strong sense of developer experience: you think about how systems are used, not just how they work
Ability to debug complex systems across multiple layers of the stack
Experience with Kubernetes, including concepts like operators and custom resources
Experience with distributed scheduling, autoscaling, or service orchestration
Experience operating GPU workloads in production
Familiarity with observability tooling, CI/CD systems, or release automation
Experience contributing to open-source infrastructure or ML systems

Competitive compensation, including meaningful equity.
100% coverage of medical, dental, and vision insurance for employee and dependents
Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
Paid parental leave
Fertility and family-building stipend through Carrot
Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

Collaborate closely with Model Performance engineers to make new inference optimizations broadly available to customers and easy to configure
At Baseten, we are committed to fostering a diverse and inclusive workplace.

This listing is sourced directly from Baseten's careers page and normalized into a canonical job model.