Fireworks AI

Fireworks AI

Member of Technical Staff, Evals & Post-Training Product

San Mateo, CA · Staff+

Sponsorship not specified$175k-$220kDetected 48 days ago
Full-Stack DevelopmentGitMachine LearningPyTorchLLMs

About the role

  • Fireworks is a Series C company valued at $4 billion and backed by top investors including Benchmark, Sequoia, Lightspeed, Index, and Evantic.
  • This role sits at the intersection of product engineering, developer experience, and model quality.
  • You will work across the stack-from APIs, SDKs, and backend systems to user-facing product surfaces in the web app-to make it easier for users to author evals, understand results, fine-tune models, and iterate quickly.

Responsibilities

  • Build internal eval workflows: Design and scale evaluation tooling used by internal teams to measure model quality, compare model changes, and inform post-training decisions.
  • Own fine-tuning product experiences: Build and improve user-facing product workflows for post-training, including fine-tuning experiences across SFT, RFT, and related model-improvement capabilities.
  • User-Centric Mindset: Willing to talk to users, triage GitHub issues for open-source projects, and build products from scratch to serve emerging needs.
  • Design and scale evaluation tooling used by internal teams to measure model quality, compare model changes, and inform post-training decisions.
  • Build and improve user-facing product workflows for post-training, including fine-tuning experiences across SFT, RFT, and related model-improvement capabilities.
  • Willing to talk to users, triage GitHub issues for open-source projects, and build products from scratch to serve emerging needs.
  • Collaborate with world-class engineers and AI researchers who thrive on curiosity and innovation.
  • Build What's Next: Work with bleeding-edge technology that impacts how businesses and developers harness AI globally.
  • Learn from the Best: Collaborate with world-class engineers and AI researchers who thrive on curiosity and innovation.
  • Experience in fast-paced environments where you own features end-to-end.

Requirements

  • Hands-on experience with LLM evaluations and/or post-training methods: How to design useful evals and use their results to guide model improvement.
  • Product Engineering Skills: The ability to work across backend systems and developer-facing product surfaces.

Nice to have

  • 3+ years of software engineering experience.
  • Open Source Contributions: Prior contributions to developer tools or AI/ML repositories.
  • Inference & Hardware Knowledge: Interest in the hardware side of AI-understanding GPU constraints, inference optimization techniques, and how they relate to model performance.
  • Why Fireworks AI?
  • Solve Hard Problems: Tackle challenges at the forefront of AI infrastructure, from low-latency inference to scalable model serving.
  • Ownership & Impact: Join a fast-growing, passionate team where your work directly shapes the future of AI-no bureaucracy, just results.
  • Fireworks AI is an equal-opportunity employer.
  • We celebrate diversity and are committed to creating an inclusive environment for all innovators.

Skills

  • The ability to work across backend systems and developer-facing product surfaces.
  • Comfortable shipping full-stack features when needed.
  • Prior contributions to developer tools or AI/ML repositories.

Compensation

  • $175,000 - $220,000 USD
  • The listed salary range is intended as a guideline and may be adjusted.

Benefits

  • Total compensation for this role also includes meaningful equity in a fast-growing startup, along with a competitive salary and comprehensive benefits package.
  • Base Pay Range (Plus Equity)

Company info

  • At Fireworks, we're building the future of generative AI infrastructure. Our platform delivers the highest-quality models with the fastest and most scalable inference in the industry. We've been independently benchmarked as the leader in LLM inference speed and are driving cutting-edge innovation through projects like our own function calling and multimodal models. Fireworks is a Series C company valued at $4 billion and backed by top investors including Benchmark, Sequoia, Lightspeed, Index, and Evantic. We're an ambitious, collaborative team of builders, founded by veterans of Meta PyTorch and Google Vertex AI.
  • We are seeking a Member of Technical Staff, Evals & Post-Training Product to help define how developers improve models on Fireworks. This role sits at the intersection of product engineering, developer experience, and model quality.
  • You will build the products and workflows that connect evaluation and post-training into a continuous loop: helping internal teams run evals at scale, enabling external developers through our open-source Eval Protocol SDK, and owning key product experiences for fine-tuning custom models on Fireworks.
  • You will work across the stack-from APIs, SDKs, and backend systems to user-facing product surfaces in the web app-to make it easier for users to author evals, understand results, fine-tune models, and iterate quickly. You will also work directly with customers and internal teams to identify friction, support real-world use cases, and turn repeated pain points into reusable product capabilities.
  • At Fireworks, we're building the future of generative AI infrastructure.
  • Our platform delivers the highest-quality models with the fastest and most scalable inference in the industry.
  • We've been independently benchmarked as the leader in LLM inference speed and are driving cutting-edge innovation through projects like our own function calling and multimodal models.
  • We're an ambitious, collaborative team of builders, founded by veterans of Meta PyTorch and Google Vertex AI.
  • We are seeking a Member of Technical Staff, Evals & Post-Training Product to help define how developers improve models on Fireworks.
  • You will also work directly with customers and internal teams to identify friction, support real-world use cases, and turn repeated pain points into reusable product capabilities.
  • Work closely with users: Partner with customers and internal stakeholders to understand evaluation and fine-tuning needs, support high-priority engagements, triage issues, and convert bespoke workflows into productized solutions.
Apply directly at Fireworks AI →Create a free account for alerts like thisView Fireworks AI immigration profile

This listing is sourced directly from Fireworks AI's careers page and normalized into a canonical job model.