Figma

Director, Research - AI Evals

San Francisco, CA • New York, NY • United States · Director · Full-time

Sponsorship not specified$258k-$348kDetected 5 days ago

Data ScienceLLMsFigmaManual TestingResearchCommunicationCollaboration

About the role

As Figma ships more AI capabilities across our products, the question "is this really good?" has never mattered more - and answering it rigorously is what this role exists to do.
This is a full time role that can be held from one of our US hubs or remotely in the United States.

Own AI evaluation methods and operations for Figma's AI-powered experiences - define quality dimensions, design how we measure them, and turn results into decision-ready signal
Build and maintain evaluation frameworks, rubrics, golden datasets, and quality bars, combining human evaluation with automated/model-based approaches (e.g., LLM-as-judge) where appropriate
Socialize a shared definition of quality so evaluation standards are adopted across teams rather than re-invented - and advocate for evaluation as a strategic partner in the product process
Manage a small team to execute our AI evals in partnership with contractors, internal staff, and/or LLMs
At Figma we celebrate and support our differences.
Experience building or co-building automated evaluation pipelines and regression testing in partnership with engineering, or familiarity with eval tooling (e.g., Braintrust, LangSmith, DeepEval, or equivalents)
2+ years in product design, user-centric product management, data science, product development, and/or front-end engineering

10+ years of experience in product, research, applied research, or a closely related field, including 2+ years of management experience
Direct, hands-on experience owning the evaluation of AI/LLM-powered products
Strength across both qualitative and quantitative methods, comfort with data and metrics, and the ability to reason about model behavior
A proven track record of gaining buy-in from executive and cross-disciplinary stakeholders - transcending methodology to articulate a larger user story and the "so what" to inspire action
Additionally, if hired you will be required to attend in person onboarding.

From idea to product, Figma empowers teams to streamline workflows, move faster, and work together in real time from anywhere in the world.

$258,000 - $348,000 USD
If based in Figma's San Francisco or New York hub offices, this role has the annual base salary range stated below.
Job level and actual compensation will be decided based on factors including, but not limited to, individual qualifications objectively assessed during the interview process (including skills and prior relevant experience, potential impact, and scope of role), market demands, and specific work location.
For roles that are available to be filled remotely, the pay range is localized according to employee work location by a factor of between 80% and 100% of range.
Figma also offers sales incentive pay for most sales roles and an annual bonus plan for eligible non-sales roles.
Figma's compensation and benefits are subject to change and may be modified in the future.

Partner with engineering to stand up repeatable, reproducible evaluation pipelines and regression testing, so evaluation is a routine part of how AI features are built and shipped

If you require accommodation, please reach out to accommodations-ext@figma.com.
equal opportunity not only to get a job, but successfully perform their job tasks to the same extent as people without disabilities.

employment opportunities regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity/expression, veteran status, or any other cha

This listing is sourced directly from Figma's careers page and normalized into a canonical job model.