Litellm

Litellm

Engineering Manager

San Francisco

Sponsorship not specifiedDetected 39 days ago
PythonLLMs5G/LTE

About the role

  • This is director-level scope with a direct line to Head of Engineering, reporting to the founder/CTO.
  • It's a genuinely hard problem because the surface is very large: 100+ provider integrations, day-zero model launches the day a new model drops, and a Rust migration in flight.

Responsibilities

  • Hold engineers accountable to the metrics they set for themselves, and own the team's goals so they ship what they commit to
  • Drive well-architected, consistent code patterns across the team
  • Own the technical roadmap with the CTO, including the Rust migration, and keep big changes gradual rather than overnight rewrites
  • Own enterprise escalations end to end: a clear plan, crisp updates, and a fast path to resolution
  • Process design: built tracking, review cadences, or release processes from scratch, with before/after numbers to show impact

Requirements

  • Been an EM before, with a track record of managing and shipping through a team
  • CS/engineering degree or equivalent hands-on engineering background

Nice to have

  • did this at an open-source company
  • scaled the eng team at a fast-growing startup

Compensation

  • Competitive salary, health, dental, and vision benefits

Benefits

  • Competitive salary, health, dental, and vision benefits
  • You won't write all the code, but you own how the team ships: engineering productivity, code quality, release health, hiring, and the open-source community.
  • Keep release health high as the team moves fast: stand up tracking, run root-cause on what slips through, own a weekly quality sync

Company info

  • engineering productivity, code quality, release health, hiring, and the open-source community.
  • You'll hold engineers accountable to the metrics they set for themselves, keep quality high as we ship fast, and own the enterprise relationship when things get hairy.
  • What We're Looking For

This listing is sourced directly from Litellm's careers page and normalized into a canonical job model.