Vmax
Member of Technical Staff - Open Endedness
San Francisco · Staff+
Sponsorship not specified$300k-$500kDetected 62 days ago
PythonMachine LearningPyTorchLLMsDesign SystemsResearchCommunication
About the role
- A core focus of ours is agents that can learn to find their own objectives in the world.
- We are looking for researchers to design and build new ways of using RL where the formulation of rewards and tasks need to be discovered, rather than given.
Responsibilities
- Develop RL methods for agents that can discover useful objectives, tasks and curricula without relying entirely on human-specified rewards.
- Build training loops where agents learn from interaction, exploration, novelty, competence progress, self-generated challenges, or other nonstandard reward signals.
- Own and develop a research agenda within Vmax, from identifying promising directions to executing experiments and communicating results.
Requirements
- Track record of strong technical work, demonstrated through publications, open-source projects, deployed systems, competitions, or equivalent contributions.
- Experience with LLM post-training
- Strong programming ability in Python and experience with at least one major ML framework such as PyTorch or JAX.
- Ability to work independently on ambiguous research problems and turn high-level ideas into concrete experimental programs.
Nice to have
- Familiarity with methods such as POET, population-based training, or multi-agent RL
- Demonstrated taste for identifying non-obvious research directions and converting them into tractable experiments.
- this role is based in our San Francisco office
Compensation
- The expected salary range for this position is $300,000 - $500,000 USD
Benefits
- Design systems for open-ended learning, including unsupervised/automated environment design, asymmetric self-play, and intrinsic motivation.
- PhD or equivalent experience in machine learning, reinforcement learning, artificial intelligence, or a closely related field.
- Deep understanding of reinforcement learning
- Strong interest in open-ended learning
Company info
- V max is an applied research lab developing AI capable of open-ended learning.
- We are building systems to exceed humans in all capacities by optimising beyond the local maxima of learning from human expertise.
This listing is sourced directly from Vmax's careers page and normalized into a canonical job model.