Harvey
Staff Software Engineer, AI Platform
New York · Staff+
Sponsorship not specified$231k-$340kDetected 5 days ago
Machine LearningAgentic AILeadership
About the role
- Your work here sets the ceiling for what Harvey's AI can do.
- Context Engineering & Agent Infrastructure.
Responsibilities
- Design and build abstractions and platform-level systems that improve all of Harvey's agentic products.
- Own infrastructure for model integration, routing, and evaluation that helps Harvey choose and deploy the right foundation model for any given context.
- Build evaluation frameworks and tooling that let every team across Harvey iterate on AI quality effectively.
- Partner closely with product engineering teams, PMs, and design to launch cutting-edge AI products.
- Experience building and shipping multi-model or multi-provider AI systems in production.
- A track record of building internal platforms, SDKs, or shared infrastructure that other engineering teams actually adopted - and an understanding of why developer experience matters as much as raw capability.
- Strong judgment about abstractions. Opinionated about good design but pragmatic about shipping incrementally.
Requirements
- 8+ years of experience building backend systems, with at least 1+ year focused on AI/ML engineering and a track record of technical leadership across teams.
Compensation
- $231,000 - $340,000 USD
Company info
- At Harvey, we're transforming how legal and professional services operate.
This listing is sourced directly from Harvey's careers page and normalized into a canonical job model.