Reducto

Machine Learning Eval Engineer

San Francisco Office

Sponsorship not specifiedDetected 127 days ago

PythonFlaskAWSMachine Learning

About the role

This is a high-impact role where you'll help define how model quality is measured at Reducto and shape the systems we use to improve it.

Design, build, and maintain evaluation benchmarks that reveal where our models perform well and where they fail.
Develop metrics, heuristics, and workflows to automatically identify new failure modes across large and messy real-world datasets.
Partner closely with other ML engineers to turn evaluation insights into model improvements and better training priorities.
Work hands-on with unstructured enterprise data, including PDFs, spreadsheets, and other difficult document formats, to uncover edge cases and hard examples.
Build lightweight internal and user-facing tools, including simple interfaces in Python frameworks like Flask, to help teams inspect results, analyze model behavior, and communicate evaluation outcomes.
Enjoy solving complex problems and building from first principles.
Collaborate effectively across technical and non-technical teams.
Have strong Python skills and can independently build clean, reliable technical solutions.
Have some background in product thinking and can build simple, polished user-facing interfaces.
Have experience in AI/ML, data infrastructure, enterprise software, or document understanding systems.

Bonus points for product and frontend experience!
Generous health insurance covering medical, dental, and vision.
We provide up to $150/mo reimbursement for health and wellness spending, such as gym memberships, fitness classes, or similar.
Work with us to build a leave schedule that works for you and your family

Collaborate with customers and internal teams to understand real-world data needs and create bespoke benchmarks that highlight Reducto's strengths.
At Reducto, we're invested in the well-being and growth of our team.
Are comfortable working directly with customers to understand their workflows and data needs.

Equal Opportunity Employer committed to diversity and inclusion in the workplace.

n, physical and mental disability, genetic information, marital status, sexual orientation, gender identity/assignment, citizenship, pregnancy or maternity, protected veteran status, or any other status prohibited by app

This listing is sourced directly from Reducto's careers page and normalized into a canonical job model.