Workato
Staff Product Manager (Evals)
Palo Alto, California · Staff+
Stay score
odds of building a lasting career here
Thin sponsorship signal and lottery-bound. A low-probability bet with your clock running. Prioritize cap-exempt roles and proven entry-level sponsors first.
Lottery odds assume a STEM candidate.
Personalize to your clock →Employer immigration record
from this employer's Department of Labor filings
Files H-1B transfers
Sourced from Department of Labor LCA, PERM and prevailing-wage disclosure data. Employer matching is by name, so figures may be split across an employer's legal entities. Absence of a filing means none appears in our copy of the data, not that none exists.
Community outcomes
No reports yet — be the first to help the next applicant.
About the role
- For more information, visit workato.com.
- Ultimately, Workato believes in fostering a flexible, trust-oriented culture that empowers everyone to take full ownership of their roles.
- But, we also believe in balancing productivity with self-care.
Responsibilities
- Externally, you'll build the evaluation experience that helps business technologists understand why their agents succeed or fail - and what to do about it.
- You've built test suites, designed evaluation criteria, and debugged agent failures in the trenches.
- Define and own the evaluation framework for Workato's internal AI agent features, driving adoption across teams starting with Agent Studio
- Build the customer-facing evaluation experience - how builders test, measure, and improve agents they create on Workato
- Partner closely with the Build Experience PM to ensure evaluation is integrated into the builder journey, not bolted on
Requirements
- 7+ years in Product Management
- Hands-on experience writing evaluations for AI/ML systems (agents, LLMs, or similar)
- Track record of shipping technical products to both internal and external users
- Experience driving adoption of frameworks or practices across engineering teams
- Bachelor's degree or equivalent experience
- You have opinions about what works, what doesn't, and where current approaches fall short.
- You can take complex evaluation concepts and make them accessible to business technologists without dumbing them down.
- You know the gap between "eval theory" and "eval reality," and you can translate that practitioner knowledge into products that work for both technical teams and non-technical builders.
Nice to have
- Experience with agent architectures, RAG systems, or LLM application development
- Background in ML engineering, solutions architecture, or technical program management before PM
- Familiarity with evaluation frameworks (e.g., human eval pipelines, automated benchmarks, red-teaming)
Skills
- Business Insider named us an "enterprise startup to bet your career on"
- Forbes' Cloud 100 recognized us as one of the top 100 private cloud companies in the world
- Deloitte Tech Fast 500 ranked us as the 17th fastest growing tech company in the Bay Area, and 96th in North America
- Quartz ranked us the #1 best company for remote workers
Company info
- We're looking for a Staff Product Manager to own evaluations for AI agents at Workato - both the internal framework that helps our teams ship better AI features, and the customer-facing tools that let builders assess and improve the agents they create.
- Spend significant time with customers understanding where they struggle to assess agent performance and what mental models they bring
This listing is sourced directly from Workato's careers page and normalized into a canonical job model.