ReflectionAI
Member of Technical Staff - Evaluations
San Francisco · Staff+
H1B sponsorship availableDetected 216 days ago
LLMsStatisticsResearchExperimental Design
About the role
- Conduct critical comparative analysis to advance our understanding of model capabilities
- Push the boundaries of what's measurable, from synthetic evals to human feedback and real-world interaction data.
Responsibilities
- Reflection is a research lab making intelligence open and accessible for everyone to use, customize, and build on.
- We build open models that let anyone control their intelligence and help shape the future of AI.
- Build and refine evaluation systems and processes that create tight feedback loops between data, evals, and model behavior
- Collaborate closely with pre-training, post-training, and applied teams to translate insights into model improvements.
- Sponsorship support: We sponsor visas to help exceptional talent join our team and support long-term immigration pathways where applicable.
- Team building: We have regular off-sites, happy hours, and team celebrations.
- Joining Reflection means building from the ground up as part of a talent-dense team.
Requirements
- Familiarity with LLM evaluation methodologies: static benchmarks, human preference evals, and/or agentic tasks.
Compensation
- Salary and equity structured to recognize and retain our talent globally.
- Health & wellness: Comprehensive medical, dental, vision, and life, with an annual wellness allowance.
Benefits
- Top-tier compensation: Salary and equity structured to recognize and retain our talent globally.
- Stock options: Everyone who joins and contributes to Reflection's success gets to share in the upside through stock options.
- Health & wellness: Comprehensive medical, dental, vision, and life, with an annual wellness allowance.
- Life & family: 22 weeks paid parental leave for all new birthing and non-birthing parents, including adoptive and surrogate journeys.
- Vacation days: Unlimited paid time off in the U.S. and 30 days in the U.K.
Company info
- make intelligence open and accessible to all.
Visa & Work Authorization
- We sponsor visas to help exceptional talent join our team and support long-term immigration pathways where applicable.
Apply directly at ReflectionAI →Create a free account for alerts like thisView ReflectionAI immigration profile
This listing is sourced directly from ReflectionAI's careers page and normalized into a canonical job model.