Tech Lead Manager, Business Agent Quality
Mountain View, CA, USA
Sponsorship not specified$207k-$300kDetected 1 day ago
Full-Stack DevelopmentData StructuresData ScienceNLPLLMsAI OrchestrationUI DesignLeadershipMentoring
> stay_score
odds of building a lasting career here
64Sponsors, lottery-bound
Cap-exempt (no lottery)0
Sponsors this role100
Entry-level history0
PERM / green-card track0
Lottery odds (Level IV)94
Fits your clock70
Sponsors, but it's cap-subject — you still face the weighted lottery (~61% per draw at Level IV). Good if you win; have a cap-exempt backup on your list.
Lottery odds assume a STEM candidate.
Personalize to your clock →> community_outcomes
No reports yet — be the first to help the next applicant.
About the role
- - Bachelor's degree or equivalent practical experience.
- - 8 years of software engineering and architecture experience testing, and launching software products.
Responsibilities
- Own the technical goal for evaluating, observing, and iterating on AI agent performance across Google's commerce ecosystem.
- Lead the development of evaluation infrastructure and automated rating systems (AutoRaters) to measure conversation helpfulness and factuality at scale.
- Bridge applied AI and engineering excellence to transition evaluation frameworks into a self-service platform for internal partners.
- Solve complex reliability issues to maintain high quality standards for LLM reasoning and low-latency agent pipelines.
Requirements
- Bachelor's degree or equivalent practical experience.
- 8 years of software engineering and architecture experience testing, and launching software products.
- Experience integrating generative AI tools or LLM interfaces into workflows.
- Experience with establishing standards for evaluation and quality metrics.
- Experience as a people manager.
Nice to have
- Master's degree or PhD in Engineering, Computer Science, or a related technical field.
- 8 years of experience with data structures and algorithms.
- 3 years of experience working in a complex, matrixed organization involving cross-functional, or cross-business projects.
- Generative AI experience.
- Experience working with conversational AI reliability metrics (e.g., helpfulness, grounding, safety) and agent orchestration harnesses with validation protocols.
- Experience collaborating with Product, Data Science, and user-facing feature teams.
- Our products need to handle information at massive scale, and extend well beyond web search.
- the list goes on and is growing every day.
Compensation
- US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits
Company info
- The mission for Google Commerce is to be an essential part of the shopping journey for consumers - from inspiration to to a simple and secure checkout experience - and the best place for retailers/merchants to connect with consumers.
This listing is sourced directly from Google's careers page and normalized into a canonical job model.