Apollo Research

Apollo Research

Research Scientist/Engineer (Evaluations)

London & San Francisco · Full-time

H1B sponsorship available$100k-$200kDetected 158 days ago
PythonData AnalysisLLMsLogisticsResearchCommunication

About the role

  • The current evals team consists of Jérémy Scheurer, Alex Meinke, Bronson Schoen, Felix Hofstätter, Axel Højmark, Teun van der Weij, Alex Lloyd and Mia Hopman.
  • You will mostly work with the evals team as well as our team of software engineers, but you will likely sometimes interact with the governance team to translate technical knowledge into concrete recommendations.
  • Equality Statement: Apollo Research is an Equal Opportunity Employer.

Responsibilities

  • ABOUT THE OPPORTUNITY We develop and run evaluations that help assess the risks posed by scheming AIs.
  • We partner with multiple labs, giving you access to a breadth of models that no single AI lab could offer.
  • These patterns are often deeply surprising and fascinating to study, e.g. the non-standard language and the reward-seeking reasoning described in our anti-scheming paper. - Build new evaluations for frontier risks, from designing novel test environments to scaling them across hundreds of distinct scenarios. - Work directly with frontier AI developers.
  • We already use automation across building, running, and analyzing evals.
  • We work on the detection of scheming (e.g., building evaluations and novel evaluation techniques), the science of scheming (e.g., model organisms and the study of scaling trends), and scheming mitigations (e.g., control).
  • We closely work with multiple frontier AI companies, e.g. to test their models before deployment and collaborate on fundamental research.

Requirements

  • Ideally, you have experience shipping and maintaining production Python code, and know how to factor messy problems into clean abstractions that others can use and extend. -
  • If you have questions about how your data is processed or wish to report concerns about fairness, please contact us at info@apolloresearch.ai.
  • If you're interested in more details about what it's like working at Apollo, you can find more information here.

Nice to have

  • You always try to improve workflows.
  • Pre-deployment evaluations are very fast paced so ideally you love shaving friction off your workflows wherever possible. -

Skills

  • Our entire stack uses Python.
  • Salary: 100k - 200k GBP (~150k - 270k USD)
  • Flexible work hours and schedule
  • Unlimited vacation
  • Unlimited sick leave
  • Up to 6 months of paid parental leave
  • Comprehensive health, dental and vision insurance
  • Retirement savings with competitive employer matching (e.g. 401(k) for US employees)
  • Lunch, dinner, and snacks are provided for all employees on workdays
  • Paid work trips, including staff retreats, business trips, and relevant conferences
  • A yearly $1,000 (USD) professional development budget
  • Relocation support and visa fees (if applicable)

Compensation

  • Lunch, dinner, and snacks are provided for all employees on workdays
  • Paid work trips, including staff retreats, business trips, and relevant conferences
  • A yearly $1,000 (USD) professional development budget
  • Relocation support and visa fees (if applicable)
  • Salary: 100k - 200k GBP (~150k - 270k USD)

Benefits

  • This role offers market competitive salary, equity, and competitive benefits.

Company info

  • Alex Meinke coordinates the research agenda with guidance from Marius Hobbhahn, though team members lead individual projects.
  • You can find our full team here.
  • Application deadline: We are conducting interviews actively and aim to fill this role as soon as we find someone suitable.
  • The rapid rise in AI capabilities offer tremendous opportunities, but also present significant risks.At Apollo Research, we're primarily concerned with risks from Loss of Control, i.e. risks coming from the model itself rather than e.g. humans misusing the AI.
  • At Apollo, we aim for a culture that emphasizes truth-seeking, being goal-oriented, giving and receiving constructive feedback, and being friendly and helpful.
  • Your Privacy and Fairness in Our Recruitment Process: We are committed to protecting your data, ensuring fairness, and adhering to workplace fairness principles in our recruitment process.
  • We are committed to protecting your data, ensuring fairness, and adhering to workplace fairness principles in our recruitment process.

Equal opportunity

  • Apollo Research is an Equal Opportunity Employer.
  • We value diversity and are committed to providing equal opportunities to all, regardless of age, disability, gender reassignment, marriage and civil partnership, pregnancy and maternity, race, religion or belief, sex, or sexual orientation.
  • Equal Opportunity Employer.

Visa & Work Authorization

  • We sponsor visas in both the UK and US.
  • Sponsorship isn't guaranteed for every role or candidate, but if we make you an offer, we'll work with you to find the right visa route

This listing is sourced directly from Apollo Research's careers page and normalized into a canonical job model.