ShyftLabs
Technical Product Manager
Toronto, Ontario
Sponsorship not specified$130k-$160kDetected 139 days ago
Distributed SystemsCI/CDDevOpsMachine LearningData EngineeringLLMsRAGAgentic AIAI OrchestrationA/B TestingProduct ManagementProduct StrategyAgileStakeholder ManagementManual TestingCommunicationProblem Solving
About the role
- We're a fast-growing startup redefining how automation, AI, and modern data infrastructure power business decisions.
- Establish and operationalize evaluation frameworks for AI products (LLM evals, benchmarking, human-in-the-loop review, automated scoring, drift monitoring).
- Define metrics for success across system performance, data quality, model reliability, latency, cost optimization, and user outcomes.
Responsibilities
- Own and drive the end-to-end lifecycle of AI- and data-intensive technical initiatives across multiple products.
- Lead product strategy for agentic systems, including orchestration layers, tool usage patterns, memory/context management, guardrails, and fallback strategies.
- Partner with engineering to design scalable architectures that support data ingestion, transformation, context retrieval, and multi-agent coordination.
- In this role, you'll define technical strategy across data platforms and AI products, drive execution of agent-based systems end-to-end, and ensure scalable, governed, and measurable delivery.
- You will operate at the intersection of data architecture, AI orchestration, and product strategy, partnering closely with engineering to build systems that are robust, observable, and continuously improving.
- Inclusion at ShyftLabs We're building something big, and we want you on the journey with us.
Requirements
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical field.
- 2-5 years of experience in technical product management, preferably in AI, ML, or data platform environments.
- Strong understanding of data architecture and data management principles, including data modeling, governance, lineage, quality monitoring, and cloud data platforms.
- Demonstrated experience working on AI-powered or agent-based products, including orchestration patterns and evaluation methodologies.
- Familiarity with LLM concepts such as context windows, retrieval augmentation (RAG), prompt orchestration, tool calling, memory management, and guardrails.
- Experience defining and operationalizing evaluation frameworks (offline/online testing, experimentation, quality metrics, performance benchmarking).
Skills
- Access extensive learning and development resources to keep leveling up your skills.
- ShyftLabs is an equal-opportunity employer committed to creating a safe, diverse, and inclusive environment.
Compensation
- Why You'll Love Working at ShyftLabs At ShyftLabs, your work matters.
- We're a growing data product company making a big impact with Fortune 500 clients and as we scale, you'll have the chance to shape solutions, influence strategy, and grow your career alongside us.
- Inclusion at ShyftLabs We're building something big, and we want you on the journey with us.
- If you're ready to use data and innovation to make an impact, apply today and let's grow together.
- ShyftLabs is an equal-opportunity employer committed to creating a safe, diverse, and inclusive environment.
Benefits
- We cover 100% of health, dental, and vision insurance premiums for you and your dependents which means no out-of-pocket costs.
- Eligibility starts from day one itself. -Growth & Learning: Access extensive learning and development resources to keep leveling up your skills.
- We encourage applicants of all backgrounds including ethnicity, religion, disability status, gender identity, sexual orientation, family status, age, and nationality to apply.
Equal opportunity
- If you require accommodation during the interview process, let us know and we'll be happy to support you.
Apply directly at ShyftLabs →Create a free account for alerts like thisView ShyftLabs immigration profile
This listing is sourced directly from ShyftLabs's careers page and normalized into a canonical job model.