Distyl AI

Applied AI Researcher, Benchmarking

San Francisco

Sponsorship not specified$150k-$250kDetected 279 days ago

ReactRailsData AnalysisSupply ChainResearchCollaboration

About the role

ABOUT DISTYL AI Distyl is an applied AI technology company partnering with the world's most ambitious institutions to rearchitect critical operations for the frontier of AI.
As a result, Distyl's technologies affect some of the world's largest operations - from hundreds of millions of consumer interactions to tens of millions of supply chain transactions and millions of patient journeys.
Our researchers come from many academic backgrounds but have strong research track records, operate in an AI-native way, and would be bored staying on the rails of a traditional research org.

Researchers design evaluation frameworks that capture reasoning depth, interaction quality, reliability, and operational impact.
Their insights drive both Distyl's internal research priorities and industry-wide standards.
Statistical and Analytical Rigor: You design fair, reproducible experiments and can extract signal from noisy empirical results
Experience Building with Models, Not Just Building Models: We develop intelligent systems using models rather than training or fine-tuning them.
Strong Programming and Data Analysis Skills: While you might not consider yourself a software engineer you need to be able to build prototypes of your ideas and then perform the experiments to prove the effectiveness to a F500 Head of AI
You design fair, reproducible experiments and can extract signal from noisy empirical results
We develop intelligent systems using models rather than training or fine-tuning them.

Experience Designing and Running Evaluations: You've built or maintained benchmarks, test suites, or experimental frameworks to measure model or system performance
Ideal candidates have expertise in compound AI systems, agentic collaboration, and associated techniques (ensembling, ReAct, graph-of-thoughts, etc.)
Proven Track Record of Research Results: Whether you've published in top journals, posted amazing work on twitter, or somewhere else we want to see what you've done
Uses AI Every Day: Before you can revolutionize someone else's workflow, you need to revolutionize yours.

100% covered medical, dental, and vision for employees and dependents
401(k) with additional perks (e.g., commuter benefits, in‑office lunch)
Access to state‑of‑the‑art models, generous usage of modern AI tools, and real‑world business problems
Ownership of high‑impact projects across top enterprises
A mission‑driven, fast‑moving culture that prizes curiosity, pragmatism, and excellence
Distyl has offices in San Francisco and New York.

The base salary range for this role is $150K - $250K, depending on experience, location, and level. In addition to base compensation, this role is eligible for meaningful equity, along with a comprehensive benefits package

In addition to base compensation, this role is eligible for meaningful equity, along with a comprehensive benefits package

a 100% production deployment success rate for our customers and one of the few enterprise AI companies to run a profitable business.
Biases Towards Showing vs Telling: Our customers want to see the power of AI today vs discuss the most elegant idea that will take 5 years to realize

This listing is sourced directly from Distyl AI's careers page and normalized into a canonical job model.