Fiddler AI

Fiddler AI

Staff AI Scientist

Palo Alto · Staff+

Sponsorship not specified$220k-$260kDetected 75 days ago
PythonCode ReviewMachine LearningPyTorchLLMsCustomer SuccessResearch

About the role

  • The rise of Generative AI and Agents has unlocked generalized intelligence but also widened the risk aperture and made it harder to ensure that AI applications are working well.
  • Joining us means you get to make an impact by ensuring that AI applications at production scale across industries have operational transparency and security.

Responsibilities

  • Lead applied research and development.
  • Partner closely with other engineering teams, Product, and Customer Success.
  • You'll build strong relationships with customer data science and ML engineering teams, supporting their AI observability journey and ensuring they realize measurable value from Fiddler.
  • Design, train, and ship production classifiers for safety, security, and quality detection (e.g., prompt injection, jailbreaks, PII, hallucination, faithfulness) under strict latency and cost constraints.
  • Lead the development of synthetic and adversarial dataset pipelines, including novel methods for generating, filtering, and validating data that exposes failure modes our models need to learn.
  • Collaborate with Backend and Platform engineers to take research prototypes from notebook to a hardened, scaled, observable service.
  • Partner with Product, Solutions Engineering, and Customer Success to translate enterprise customer needs into research problems and translate research results back into product.
  • Mentor AI Scientists on the team, raise the technical bar through code review and design review, and represent Fiddler externally through publications, talks, or open-source contributions when appropriate.
  • Excited by the prospect of using AI coding tools in your own workflow to push the limits of what one engineer can ship - responsibly, with a clear eye on quality, security, and the failure modes these tools introduce
  • Our team is motivated to help build trust into AI to enable society harness the power of AI.

Requirements

  • Hands-on experience with dataset development as a first-class engineering discipline: sourcing, labeling, synthetic generation, adversarial augmentation, and quality control
  • Strong applied experience with LLMs and agentic systems - prompting, fine-tuning, and evaluation
  • Proficiency in Python and the modern ML stack (PyTorch, Hugging Face, common training/serving frameworks)
  • Experience with synthetic data generation pipelines at scale

Skills

  • Fiddler enables organizations to get ahead of these issues by helping deploy trustworthy, and transparent AI solutions.
  • Our platform enables engineering teams and business stakeholders alike to understand the "what", "why", and "how" behind AI outcomes.
  • Our Founders
  • The AI and ML industry has a rapid pace of innovation and the learning opportunities here are monumental.
  • This is your chance to be a trailblazer.
  • Fiddler is recognized as a pioneer in the field of
  • AI Observability and has received numerous accolades, including:

Compensation

  • For Bay Area, Seattle & New York City: $220,000 - $260,000 + equity & benefits
  • Other cities $175,000-$230,000 + equity & benefits
  • Competitive pay + equity
  • Team and company events and offsites (this year was Las Vegas)
  • Palo Alto HQ Vibes
  • Annual Caltrain pass

Benefits

  • Our team thrives on knowledge sharing, peer learning, and collective problem solving - no one works in a silo.

Company info

  • We operate in a hybrid capacity, but stay deeply connected through constant communication, collaboration, and shared purpose.
  • Every project is a team effort, and every win is shared.
  • If you love working alongside smart, driven peers who genuinely care about both customer success and each other's growth, you'll feel right at home here.
  • 🚀 WHAT YOU'LL DO:
  • Lead applied research and development. Lead applied research and development for the models and datasets at the core of Fiddler's Trust Service and suite of guardrail classifiers and evaluators that customers depend on to keep their LLM and agentic applications safe, accurate, and compliant in production.
  • Partner closely with other engineering teams, Product, and Customer Success. You'll build strong relationships with customer data science and ML engineering teams, supporting their AI observability journey and ensuring they realize measurable value from Fiddler.
  • Drive the technical direction of generative insights - the LLM- and agent-powered analysis layer that helps customers diagnose what's going wrong in their AI applications and why.
  • Contribute to the evaluation and experimentation infrastructure that lets the AI Science team and our customers reliably measure model quality, regression, and drift across rapidly evolving model populations.
  • Explore reinforcement learning and preference-based methods where they offer real leverage over supervised baselines.

Equal opportunity

  • Fiddler is proud to be an equal opportunity employer.
Apply directly at Fiddler AI →Create a free account for alerts like thisView Fiddler AI immigration profile

This listing is sourced directly from Fiddler AI's careers page and normalized into a canonical job model.