Robots and Pencils
Technical Product Manager
US - Remote · Staff+
Sponsorship not specifiedDetected 34 days ago
JavaScriptTypeScriptPythonElasticsearchAWSLLMsRAGAgentic AIAI OrchestrationProduct ManagementProduct StrategyAgileStakeholder ManagementPRDsResearchLeadership
About the role
- As a Staff PM, you're accountable for initiative-level outcomes, stakeholder satisfaction, and contributing to R&P's AI product practice.
Responsibilities
- Design and run experiments - POCs, pilot deployments, scenario-based testing of multi-step workflows, edge cases, and failure recovery - to validate agentic solutions where non-deterministic output makes traditional QA insufficient
- Agent Design, Prototyping & Production
- partner with engineering on context management - summarization, working memory, and information flow across multi-step tasks
- Define agent behavior and prototype system prompts and tool schemas; partner with engineering on context management - summarization, working memory, and information flow across multi-step tasks
- Drive multi-model architecture tradeoffs with engineering - define the quality, cost, and latency targets that determine which model serves each step in the agent workflow
- Build AI prototypes to validate hypotheses; define human-in-the-loop boundaries and guardrails - when the agent acts autonomously, when it escalates, and how to handle non-deterministic output
- Establish agent evaluation frameworks - task completion, reasoning quality, tool selection, failure recovery, safety - and partner with engineering on production readiness (observability, drift, responsible AI, prompt versioning)
- Own the end-to-end product lifecycle from discovery through phased rollouts; establish the metrics framework (north star, input, guardrail metrics) and report product impact to leadership
- Manage the product backlog, scope, dependencies, and risks; drive agile ceremonies and produce high-quality PRDs, product briefs, and decision logs
- Evaluate technology and platform decisions from a product perspective; create deployment playbooks, reference architectures, and knowledge transfer materials so teams sustain solutions independently
Requirements
- 8-12+ years in product management, forward deployment, or solutions engineering
- must have shipped AI products from prototype through production at scale
Nice to have
- Software engineering or coding background (Python, JavaScript, TypeScript)
- Agency or consulting delivery experience
- Familiarity with open-source LLM ecosystem (Llama, Mistral) for flexibility and cost optimization
- Prior experience leading time-boxed discovery initiatives or technical spikes with rapid validation cycles
- You'll work at the intersection of cutting-edge AI and real enterprise impact - helping clients deploy Generative and Agentic AI solutions that change how their businesses operate.
- The team is collaborative, technically sharp, and genuinely invested in doing great work for clients.
Apply directly at Robots and Pencils →Create a free account for alerts like thisView Robots and Pencils immigration profile
This listing is sourced directly from Robots and Pencils's careers page and normalized into a canonical job model.