Thinking Machines Lab
Research, Post-Training Evals
San Francisco
H1B sponsorship available$350k-$475kDetected 51 days ago
PythonMachine LearningDeep LearningTensorFlowPyTorchLLMsAuditingLogisticsResearchCommunicationCollaboration
Stay score
odds of building a lasting career here
59Sponsors, lottery-bound
Cap-exempt (no lottery)0
Sponsors this role80
Entry-level history0
PERM / green-card track0
Lottery odds (Level IV)94
Fits your clock70
Sponsors, but it's cap-subject — you still face the weighted lottery (~61% per draw at Level IV). Good if you win; have a cap-exempt backup on your list.
Lottery odds assume a STEM candidate.
Personalize to your clock →Employer immigration record
from this employer's Department of Labor filings
Files H-1B transfers
16 transfer filings in the last year, covering 16 workers. Median labor-condition decision: 7 days. An employer that already files transfers is one that can take over an existing H-1B.
Sourced from Department of Labor LCA, PERM and prevailing-wage disclosure data. Employer matching is by name, so figures may be split across an employer's legal entities. Absence of a filing means none appears in our copy of the data, not that none exists.
Community outcomes
No reports yet — be the first to help the next applicant.
About the role
- This role spans evaluation creation, usability, auditing, and efficiency.
- You'll work closely with researchers and engineers across post-training and the broader research organization.
- Depending on your interests and experience, you may focus on one area or work across several of these problems.
Responsibilities
- Create internal evaluations and research signals for capabilities and behaviors important to model research and post-training.
- Develop usability evaluations that measure whether models are genuinely useful in real research and product workflows, and partner with the data flywheel to turn evaluation insights into better data and training signals.
- Build benchmark auditing methodologies that help researchers understand, trust, and appropriately use evaluation signals.
- Develop specialized agentic evaluation environments and user simulators, including supporting harness development and studying cross-user, cross-harness and cross-environment generalization.
- Develop evaluations for personalized preferences, biases, values, and other nuanced dimensions of model behavior in collaboration with post-training crafting.
- Experience designing, building, or analyzing evaluations, benchmarks, datasets, graders, or other measurement systems.
- Strong written and verbal communication skills, with the ability to collaborate effectively across research and engineering teams.
Requirements
- Experience with evaluation auditing, human evaluations, LLM-judges, or open-ended task evaluation.
- Experience with agentic evaluation, harnesses, long-horizon tasks, or RL environments.
- Experience evaluating preferences, personalization, biases, values, or other nuanced model behaviors.
Nice to have
- we encourage you to apply if you meet some but not all of these:
Compensation
- Depending on background, skills and experience, the expected annual salary range for this position is $350,000 - $475,000 USD.
Benefits
- Thinking Machines offers generous health, dental, and vision benefits, unlimited PTO, paid parental leave, and relocation support as needed.
- Bachelor's degree or equivalent experience in Computer Science, Machine Learning, Physics, Mathematics, or a related discipline with strong theoretical and empirical grounding.
- Experience with LLMs, post-training, reinforcement learning, or agentic systems.
Company info
- The mission of Thinking Machines is to build AI that extends human will and judgment.
Visa & Work Authorization
- We sponsor visas.
- While we can't guarantee success for every candidate or role, if you're the right fit, we're committed to working through the visa process together.
Apply directly at Thinking Machines Lab →Create a free account for alerts like thisView Thinking Machines Lab immigration profile
This listing is sourced directly from Thinking Machines Lab's careers page and normalized into a canonical job model.