HUD
Research Engineer, Benchmarks
San Francisco · Full-time
Sponsorship not specifiedDetected 8 days ago
PythonDockerLinuxAgentic AILogisticsResearchCommunicationCollaboration
About the role
- We're looking for Research Engineers to build high-quality benchmarks for evaluating frontier agents on domain-specific tasks.
- You'll build benchmarks that are technically rigorous, practically useful, and credible to frontier labs.
Responsibilities
- Own the design, implementation, and quality of HUD's internal agent benchmarks
- Work with subject-matter experts to define tasks and create domain-specific benchmarks that evaluate agents on realistic workflows
- Build infrastructure to reliably run models and agents against benchmark tasks
- Develop metrics and analyses to understand benchmark difficulty, reliability, and failure modes
- Validate whether benchmark performance correlates with real-world evals, customer needs, and lab expectations
Requirements
- Proficiency in Python, Docker, and Linux environments
- Strong understanding of what a "good benchmark" means and what makes one realistic, reliable, and useful
- Experience working on environments and evals
- Curiosity and ability to truly understand how workflows in various domains work
- Early-stage startup experience with ability to work independently in fast-paced environments
- You may be a good fit if you have:
Compensation
- Competitive compensation
Benefits
- 100% covered top-of-the-line medical, dental, and vision from Blue Shield of CA (US employees)
- Company-wide holiday break (Christmas Eve to New Year's Day) on top of PTO and paid holidays
- Other perks including an Equinox membership, 401k, and commuter benefits (US employees)
Company info
- We have 8 figures in funding and high revenue growth.
- We're scaling profitably and quickly to meet very strong demand.
- Our team includes 4 International Olympiad medalists (IOI, ILO, IPhO), serial AI startup founders, and researchers with publications at ICLR, NeurIPS, etc.
Visa & Work Authorization
- Visa Sponsorship: We provide support for relocation and visas for strong full-time candidates to the US or Singapore.
This listing is sourced directly from HUD's careers page and normalized into a canonical job model.