Box
Product Manager II, AI Evaluations
Redwood City, CA, United States · Mid
Sponsorship not specified$161k-$201kDetected 1 day ago
PythonSQLMachine LearningProduct ManagementCommunicationCollaborationPublic Speaking
About the role
- Box (NYSE:BOX) is the leader in Intelligent Content Management.
- We help companies thrive in the new AI-first era of business.
- Box is headquartered in Redwood City, CA, with offices across the United States, Europe, and Asia.
Responsibilities
- Drive synthetic data generation and data-generation pipelines to ensure they are high-quality, reliable, and scalable.
- Own online evaluations, turning real production usage into rich insight on how our product is actually used.
- Lead each model launch end to end, managing the process, the stakeholders, and the timeline.
- Own the external narrative for each model launch - partnering with Product Marketing on blog, social, and PR content, and creating video demos yourself.
- Build and manage deep relationships with model providers and AI companies - securing early access to frontier models, delivering technical deep-dives back to providers, and identifying collaboration opportunities on evaluations and benchmarking.
- Identify, pitch, and structure opportunities to collaborate with providers and other AI companies specifically on evaluations and benchmarking.
- Run evaluations to decide whether a model is production-ready, and own the decision of which models power agentic products at Box.
- Assess the compliance posture of production models, partner on model pricing decisions, and define how and when we deprecate models.
- You'll run rigorous evaluations of frontier models, own the decision of which models power Box Agents, shape how the world's leading model providers understand enterprise performance, and own the full lifecycle of every model we support.
- statistically literate, comfortable in code, and able to build the evals, run the analyses, and prototype the pipelines themselves rather than spec them out for someone else.
Requirements
- You have a minimum of 2 years of product management experience.
- If you are head-over-heels about this role but unsure if you meet all the requirements, we encourage you to apply!
Nice to have
- You've driven cross-functional launches across Product Marketing, Communications, Developer Relations, and Engineering.
- You're an excellent written and verbal communicator who can represent Box externally, presenting complex, technical topics simply to senior stakeholders.
- You operate with extremely high agency, taking ambiguous, undefined problems and driving them to resolution on tight timelines.
- You're fluent across many stakeholders-from Product Marketing and Sales to Security, Legal, and Compliance-adapting your communication to each audience.
- You're a natural disambiguator who makes messy, fast-moving AI problems simple and clear.
- Direct experience with AI/ML products, model evaluation, or benchmarking.
- Experience managing external partnerships with vendors or providers.
- Preferred skills
Compensation
- Actual base salary (or
- OTE if commissionable role) is dependent upon factors such as:
- United States Pay Range
- $160,500 - $200,500 USD
Benefits
- This role is also eligible for equity and benefits.
- For more information, check out our benefits and perks.
Company info
- We are an AI-first company. This means you approach your work with a growth mindset and find ways to leverage AI to help make faster, smarter decisions that will 10X your impact at Box.
- Our platform enables organizations to fuel collaboration, manage the entire content lifecycle, secure critical content, and transform business workflows with enterprise AI.
- Founded in 2005, Box simplifies work for leading global organizations, including JLL, Morgan Stanley, and Nationwide.
- Our mission is to bring intelligence to the world of content management and empower our customers to completely transform workflows across their organizations.
- We're looking for a high-agency, deeply AI-fluent Product Manager to own AI Evaluations - a highly cross-functional, highly visible role at the front lines of how Box assesses, launches, and manages the AI models that power our product.
Equal opportunity
- We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability, and any other protected ground of discrimination under applicable human rights legislation. Box strives to respect the dignity and independence of people with disabilities and is committed to giving them the same opportunity to succeed as all other employees. Inclusiveness is core to our culture at Box, and we strive to ensure you get the most from your interview experience.
- Box makes reasonable accommodations for applicants with disabilities. If a reasonable accommodation is needed to participate in the job application or interview process, please complete this form. Reasonable accommodations may include scheduling adjustments, document dictation and beyond.
- Notice to applicants in Los Angeles: Box, Inc and its related branches will consider for employment, qualified applicants with criminal histories in a manner consistent with the Los Angeles Fair Chair Ordinance. The Fair Chance Ordinance is provided here.
- Notice to applicants in San Francisco: Box, Inc and its related branches will consider for employment, qualified applicants with criminal histories in a manner consistent with the San Francisco Fair Chair Ordinance. The Fair Chance Ordinance is provided here.
This listing is sourced directly from Box's careers page and normalized into a canonical job model.