Software Engineer, Agent Optimization & Evaluation
Remote - United States · Senior · Contract
Sponsorship not specified$110k-$325kDetected 2 days ago
Platform EngineeringLLMsAgentic AIA/B TestingCollaborationMentoring
Stay score
odds of building a lasting career here
61Sponsors, lottery-bound
Cap-exempt (no lottery)0
Sponsors this role90
Entry-level history0
PERM / green-card track0
Lottery odds (Level IV)94
Fits your clock70
Sponsors, but it's cap-subject — you still face the weighted lottery (~61% per draw at Level IV). Good if you win; have a cap-exempt backup on your list.
Lottery odds assume a STEM candidate.
Personalize to your clock →Employer immigration record
from this employer's Department of Labor filings
Green-card filing pattern in this occupation
Context, not a finding about this posting: of this employer's 8 green-card filings in this occupation, 88% were for a worker who already held the job.
Files H-1B transfers
35 transfer filings in the last year, covering 35 workers. Median labor-condition decision: 7 days. An employer that already files transfers is one that can take over an existing H-1B.
Sourced from Department of Labor LCA, PERM and prevailing-wage disclosure data. Employer matching is by name, so figures may be split across an employer's legal entities. Absence of a filing means none appears in our copy of the data, not that none exists.
Community outcomes
No reports yet — be the first to help the next applicant.
About the role
- As a Software Engineer, Agent Optimization & Evaluation, you will lead our agent optimization and evaluation platform.
- You'll build systems to measure and improve agents' impact on engineering velocity, including Reddit-specific evaluation environments, intelligent model orchestration, and feedback loops that learn from production usage.
- This hands-on role involves writing production code and building new systems with ownership and autonomy.
Responsibilities
- Design and build Reddit's agent optimization harness for evaluating, benchmarking, and improving AI agents across real software engineering workflows.
- Develop Reddit-specific evaluation environments that accurately measure agent performance against meaningful engineering tasks.
- Build systems for offline replay, automated evaluation, synthetic task generation, regression detection, and human-in-the-loop feedback.
- Design model routing and orchestration strategies that optimize for quality, latency, and cost.
- Build tooling to analyze agent behavior, investigate failures, and accelerate iteration.
- Partner closely with Platform Engineering, Infrastructure, and Developer Productivity teams to integrate agent capabilities into engineering workflows.
- Extensive experience building and shipping large-scale production software systems.
- Experience building systems that optimize across multiple dimensions, including quality, latency, reliability, and cost.
- Family Planning Support
Requirements
- Strong understanding of modern LLMs, AI agents, and the engineering systems required to deploy them effectively.
Compensation
- In addition to base salary, this job is eligible to receive equity in the form of restricted stock units, and depending on the position offered, it may also be eligible to receive a commission.
- To provide greater transparency to candidates, we share base salary ranges for all US-based job postings regardless of state.
- We set standard base pay ranges for all roles based on function, level, and country location, benchmarked against similar stage growth companies.
Benefits
- Comprehensive Healthcare Benefits and Income Replacement Programs
- Global Benefit programs that fit your lifestyle, from workspace to professional development to caregiving support
- Mental Health & Coaching Benefits
- Flexible Vacation & Paid Volunteer Time Off
- Generous Paid Parental Leave
- In addition to base salary, this job is eligible to receive equity in the form of restricted stock units, and depending on the position offered, it may also be eligible to receive a commission.
- Additionally, Reddit offers a wide range of benefits to U.S.-based employees, including medical, dental, and vision insurance, 401(k) program with employer match, generous time off for vacation, and parental leave.
Company info
- We're building Reddit's next-generation AI developer platform: a best-in-class agent stack that helps every Snoo build, test, review, and ship software efficiently while preserving Reddit's control over quality, costs, and long-term AI strategy.
- Our optimization harness measures and improves agents across the software development lifecycle by benchmarking models, detecting regressions, optimizing routing, incorporating production feedback, and improving developer productivity.
- You'll report to Kyle Maxwell and partner with Platform Engineering, Infrastructure, and Developer Productivity to shape AI-assisted software development across Reddit.
Equal opportunity
- Reddit is proud to be an equal opportunity employer, and is committed to building a workforce representative of the diverse communities we serve.
- If, due to a disability, you need an accommodation during the interview process, please let your recruiter know.
Visa & Work Authorization
- You will have the opportunity to opt out of recording, transcription and summarization prior to any scheduled interviews.
This listing is sourced directly from Reddit's careers page and normalized into a canonical job model.