Judgmentlabs
Full stack engineer
San Francisco · Full-time
Sponsorship not specifiedDetected 8 days ago
Full-Stack DevelopmentLLMsCommunicationProblem Solving
About the role
- Judgment is the learning infrastructure for AI agents.
- Agents in production don't improve from prompts alone.
- They improve from experience: the tasks they attempt, the mistakes they make, the edge cases they hit.
Responsibilities
- Build the platform for verifying agent changes: hosted simulated environments for stateful agent evals, trajectory replay against changed agents, and monitors for unintended behavior changes.
- Design how engineers understand what their agents did and why.
- Design how humans watch a swarm work, redirect investigators that go down the wrong path, and consume findings without reading a hundred reports.
- Build the workflows that turn production trajectories into datasets, judges, and regression checks, so the path from "found a problem" to "verified a fix" feels like one motion.
- You'll build the product experiences that make this loop legible, and you'll build the agents that run it.
- This is not a role where you implement specs handed down.
- Verification: Build the platform for verifying agent changes: hosted simulated environments for stateful agent evals, trajectory replay against changed agents, and monitors for unintended behavior changes.
Skills
- Strong technical problem-solving skills, especially in fast-changing, ambiguous environments
- A builder and tinkerer's mindset with high agency - you find creative ways to overcome obstacles and ship
- Excellent communication skills - clear, direct, and persuasive across technical and non-technical audiences
Company info
- Comfort working directly with customers to understand their needs and solve real-world problems
- talking to customers, defining what to build, building it, and iterating until it's great.
- You'll own problems end-to-end: talking to customers, defining what to build, building it, and iterating until it's great.
Apply directly at Judgmentlabs →Create a free account for alerts like thisView Judgmentlabs immigration profile
This listing is sourced directly from Judgmentlabs's careers page and normalized into a canonical job model.