ID.me
Staff Software Engineer- AI Agent Evaluations
Mountain View, California, United States · Staff+ · Full-time
Stay score
odds of building a lasting career here
Sponsors, but it's cap-subject — you still face the weighted lottery (~61% per draw at Level IV). Good if you win; have a cap-exempt backup on your list.
Lottery odds assume a STEM candidate.
Personalize to your clock →H-1B wage level
the lottery is wage-weighted — each level is one more entry
The bottom of this range ($63,000) is below the Level I prevailing wage of $94,370. An H-1B cannot be filed below the prevailing wage, so an offer at the floor of this band could not be sponsored as posted.
Based on the DOL prevailing wage for this occupation and worksite, a base salary of $123,843 would place this position at wage Level II. That figure is within the posted range, and I'd like to target it. This role classifies under "Software Developers" for prevailing-wage purposes.
DOL prevailing wage, 2026-27 wage year · Software Developers (15-1252) · Bakersfield-Delano, CA. Wage level is derived by USCIS from the offered wage, occupation and worksite; the occupation shown is inferred from the job title.
Employer immigration record
from this employer's Department of Labor filings
Files H-1B transfers
Sourced from Department of Labor LCA, PERM and prevailing-wage disclosure data. Employer matching is by name, so figures may be split across an employer's legal entities. Absence of a filing means none appears in our copy of the data, not that none exists.
Community outcomes
No reports yet — be the first to help the next applicant.
About the role
- This Staff Engineer role sits at the intersection of engineering, applied AI, testing and developer experience.
Responsibilities
- Define AI Quality Standards: Own the framework for how ID.me evaluates, validates, and monitors AI agents - from prompt-based features to fully autonomous multi-step workflows.
- Build Eval Infrastructure: Design and maintain evaluation pipelines for LLM outputs, agent behavior, tool use, and multi-turn interactions across development, staging, and production environments.
- Agentic Test Strategy: Lead the design of test suites that handle non-determinism - red-teaming agents, golden dataset construction, LLM-as-judge pipelines, and property-based testing for AI outputs.
- Champion Developer Experience: Build the internal tooling, feedback loops, and testing workflows that make it fast and safe for engineers to develop and ship AI features with confidence.
- Cross-Team Collaboration: Partner with Security, Platform, Product, and AI/ML teams to embed quality gates into agent development workflows.
- Mentorship: Guide senior and mid-level engineers through evaluation design, observability strategy, and testing approaches specific to AI systems.
- Own the framework for how ID.me evaluates, validates, and monitors AI agents - from prompt-based features to fully autonomous multi-step workflows.
- Build Eval Infrastructure:
- Design and maintain evaluation pipelines for LLM outputs, agent behavior, tool use, and multi-turn interactions across development, staging, and production environments.
- Lead the design of test suites that handle non-determinism - red-teaming agents, golden dataset construction, LLM-as-judge pipelines, and property-based testing for AI outputs.
Requirements
- Bachelor's degree in Computer Science, Engineering, or equivalent experience
- Demonstrated experience evaluating or testing LLM-powered features or autonomous agents in production
- Proficiency with AI-assisted development tools (Claude Code, Cursor, or equivalent) - you build with AI every day
- Experience designing test infrastructure, CI/CD quality gates, or evaluation pipelines at scale
- Familiarity with agentic frameworks (Claude API / Anthropic SDK, BrainTrust, LangChain, LangGraph, CrewAI, or similar)
- Production monitoring experience for AI systems: behavioral drift detection, output sampling, shadow scoring
- Red-teaming or adversarial testing experience for AI models or agents
Nice to have
- Background in identity verification, fraud detection, or regulated industries
- Familiarity with Anthropic's model evaluation methodology or similar published eval research
- Experience with observability tooling (Datadog, OpenTelemetry) applied to AI workloads
- All ID.me employees share in the responsibility for fulfilling our commitment to equal employment opportunity.
- Upon request we will provide you with more information about such accommodations.
- ID.me participates in E-Verify.
Compensation
- The annual base salary listed does not include a company bonus, incentive for sales roles, equity and benefits which will be determined based on experience, skills, education, relevant training, geographic location and role.
Benefits
- Over 175 million users experience streamlined login and identity verification with ID.me at 22 federal agencies, 50 state government agencies, and more than 100 healthcare organizations.
- Drive AI-First Engineering Culture: Raise the quality bar across the engineering org by establishing patterns, tooling, and education for how teams write, test, and deploy AI features responsibly.
Company info
- At ID.me, we embrace the thoughtful use of AI tools in our daily work and there are even occasions where we leverage AI in our hiring process.
This listing is sourced directly from ID.me's careers page and normalized into a canonical job model.