Litellm

Rust Engineer

San Francisco

Sponsorship not specifiedDetected 35 days ago

PythonRustPostgreSQLRedisLLMs

About the role

The work is fundamentally about performance.
Every decision you make will move us toward being the lowest-latency, highest-throughput gateway in the category, without ever compromising the reliability our enterprise customers depend on.
You will be the person leading the entire Python-to-Rust migration.

Own the end-to-end migration of LiteLLM from Python to Rust, from architecture through rollout.
Design and execute a gradual rollout that holds stability as the top constraint while the migration progresses.
Drive performance gains across latency, throughput, and resource efficiency at 1B+ requests/mo.
Collaborate cross-functionally to ensure the migration aligns with backend priorities across performance, reliability, and security.
Own one of the most important technical bets in the company's roadmap.

Deep, long-standing expertise in Rust.
Strong instinct for stability, with a track record of balancing ambitious change against reliability.

prior experience leading codebase migrations from another language to Rust.
Familiarity with backend infrastructure, databases (PostgreSQL, Redis), and high-volume production systems.
Define the architectural foundation that the entire platform will run on.
Fast-paced growth environment with deep technical ownership.

Competitive salary, health, dental, and vision benefits.
Major bonus: prior experience leading codebase migrations from another language to Rust.
Major bonus: a demonstrated history of shipping performance-critical systems.

you'll plan the migration directly with the CTO, structure the codebase so it's ready for Rust, and lead a gradual, stability-first rollout.
This is a single-owner mandate.
What We're Looking For

This listing is sourced directly from Litellm's careers page and normalized into a canonical job model.