HUD

Research Engineer, QC Automation

San Francisco · Full-time

Sponsorship not specifiedDetected 8 days ago

PythonDockerLinuxLLMsAgentic AIAuditingLogisticsResearchCommunicationCollaboration

About the role

We're looking for Research Engineers to automate QC for training data created by companies using HUD's infrastructure.

Create QC systems based on true understanding and human judgement, without relying heavily on LLMs
Design experiments and metrics to grade agent outputs
Partner with data vendors to debug quality issues and diagnose agent failure modes, provide actionable feedback, and improve their data generation processes

Proficiency in Python, Docker, and Linux environments
Strong understanding of what "good data" means and how to measure it
Experience working on benchmarks and evals - you can reason about what makes a task realistic, a rubric reliable, an environment usable, and a trajectory useful for RL training
Early-stage startup experience with ability to work independently in fast-paced environments
Have experience with existing benchmarks and can reason about how to construct tasks in new evals
You may be a good fit if you have:

100% covered top-of-the-line medical, dental, and vision from Blue Shield of CA
Company-wide holiday break (Christmas Eve to New Year's Day) on top of PTO and paid holidays
Other perks including an Equinox membership, 401k, and commuter benefits

We have 8 figures in funding and high revenue growth.
We're scaling profitably and quickly to meet very strong demand.
Our team includes 4 International Olympiad medalists (IOI, ILO, IPhO), serial AI startup founders, and researchers with publications at ICLR, NeurIPS, etc.

Visa Sponsorship: We provide support for relocation and visas for strong full-time candidates to the US.

This listing is sourced directly from HUD's careers page and normalized into a canonical job model.