Harness
Director of Product Management, AI Evals
Mountain View, California, United States · Director
Sponsorship not specified$265k-$280kDetected 61 days ago
CI/CDDevOpsRESTMachine LearningLLMsAgentic AIA/B TestingCybersecurityProduct ManagementStakeholder ManagementValuationCustomer SuccessCiscoResearchCommunication
About the role
- Work closely with GTM teams (sales, marketing, customer success) on positioning, adoption, and revenue growth.
- Engage directly with customers to shape the roadmap, improve adoption, and ensure measurable business impact.
- AI is moving from experimentation to production faster than any technology shift in recent memory, and the teams shipping it are discovering that traditional software testing breaks down for LLM-powered systems.
Responsibilities
- Design AI-assisted experiences for eval authoring, failure analysis, and remediation recommendations.
- Partner with engineering to deliver scalable, differentiated solutions that developers love.
- Drive competitive positioning and track product metrics
- Goldman Sachs leads investment in software delivery startup Harness at $5.5 billion valuation
- Harness has been named to the Inc. Power Partner list for software delivery success
- We are hiring a Director of Product Management to lead Harness's AI Evaluation module defining how engineering teams measure, validate, and continuously improve AI and LLM-powered applications in production.
Nice to have
- Familiarity with prompt engineering, fine-tuning pipelines, and dataset versioning.
- Exposure to AI governance, responsible AI frameworks, or automated remediation.
- Cloud-native and enterprise SaaS experience.
- Employee Assistance Program (EAP)
- What you will have at Harness
Skills
- Evaluation is the missing layer, and it's becoming the bottleneck for enterprise AI adoption.
- 8+ years of product management experience, including AI/ML technologies, developer tooling, or platform products.
- Experience owning business outcomes including strategy, positioning, and revenue impact.
- Strong communication and stakeholder management skills across product, engineering, and GTM teams.
- Obsessed with customer success and outcome-driven.
Compensation
- $265,000 - $280,000 USD
Benefits
- This role has end-to-end business ownership of our AI Evals module, including vision, strategy, and P&L
- Own the vision, strategy, roadmap, and P&L for Harness's AI Evals module.
Company info
- Accelerating Our Mission to Bring AI to Everything After Code
- How Harness runs 16 "startups within a startup" at scale | Jyoti Bansal
- Harness Research Shows AI Visibility Crisis Fueling Security Nightmare
Apply directly at Harness →Create a free account for alerts like thisView Harness immigration profile
This listing is sourced directly from Harness's careers page and normalized into a canonical job model.