Mitratech
Senior Engineering Manager, AI Quality & Governance
Remote US · Senior
Sponsorship not specifiedDetected 20 hours ago
Platform EngineeringLLMsLeadership
About the role
- Over time these may grow into separate teams with separate leaders, but today they are tightly linked in both problem space and execution model.
- The role combines platform engineering, applied AI quality, incident ownership, and practical governance implementation.
- This is explicitly a hands-on leadership role.
Responsibilities
- Own the AI evaluations and observability platform - tracing, logs, dashboards, quality signals, and operational feedback loops for prompts, model calls, tool use, and user outcomes
- Design and operationalize automated and human-in-the-loop evaluation strategies, integrating regression checks for quality, safety, latency, and cost into engineering and release processes
- Build and operate AI guardrails and policy enforcement capabilities: content controls, PII detection and redaction, audit logging, and request- or workflow-level policy checks
- Own platform-level SLOs and tier-two incident support for AI behavior issues, partnering with product teams who remain first-line owners for features they ship
- Demonstrated hands-on experience building, shipping, or operating production AI systems - ideally including LLM-powered or agentic workflows
Requirements
- Strong experience designing and operating production backend systems and APIs
- Experience with AI observability, evaluation, or debugging systems - whether through platforms such as LangSmith or LangFuse, or through internally built equivalents
- Act as an internal authority on AI quality and governance and participate in customer-facing conversations where product quality, safety, observability, or governance posture must be explained credibly
- You have shipped production AI systems and have hands-on experience with the operational complexity they introduce.
Skills
- For over 35 years, the experts at Mitratech have been focused on solving the complex needs.
- About the AI Platform Organization
- The mandate is not just to ship isolated AI features.
- stream-aligned product teams sit at the top, an AI Platform layer sits in the middle, and Cloud & Data Foundation sits below.
Company info
- What We Are Looking For
Apply directly at Mitratech →Create a free account for alerts like thisView Mitratech immigration profile
This listing is sourced directly from Mitratech's careers page and normalized into a canonical job model.