Klue
Senior Software Engineer, Agents
Vancouver, British Columbia · Senior · Full-time
Sponsorship not specifiedDetected 32 days ago
PythonDistributed SystemsFull-Stack DevelopmentGitPostgreSQLElasticsearchVector DatabasesAWSGCPAzureCloud PlatformsDockerKubernetesCI/CDTemporalMachine LearningData EngineeringLLMsRAGAgentic AILLMOpsAI OrchestrationA/B TestingCRM
About the role
- You'll bring a builder's mindset, scientific rigor, and relentless customer focus.
- You'll have an outsized impact on the product while staying close to the frontier of AI.
- This means optimizing across the full stack: inference costs at scale, retrieval and query performance, and the feedback loops that make agents genuinely improve over time.
Responsibilities
- Build and ship backend systems that power agentic workflows.
- Improve LLM-powered workflows end to end. From prompt design and retrieval strategy to caching and latency optimization, you'll make our agent responses faster, more accurate, and more reliable in production.
- Own evaluation of agentic systems at scale.
- You develop and operate evaluation frameworks (automated, offline, and human-in-the-loop) that measure relevance, quality, latency, and end-to-end task success across our agent pipelines.
- You'll define what "good" looks like and build the infrastructure to measure it continuously.
- Design and build human-in-the-loop systems.
- Working closely with product and design, you propose and prototype feedback mechanisms, review workflows, and correction loops that keep AI agents accurate and trusted over time.
- Collaborate across product, infrastructure, and data teams. Align technical direction with product goals, contribute to architecture decisions, and help the team move faster by establishing patterns and best practices for production-grade agentic systems.
- In this role, you will own projects end-to-end, guiding architecture decisions, experimentation strategy, and production readiness for our LLM-powered agents.
- We ensure it's trustworthy, automated, and activated across every department, so they have the answers they need to own their market.
Requirements
- You're comfortable with Python and have experience with backend frameworks, APIs, and production infrastructure.
- Familiarity with search and retrieval systems.
- Experience with cloud infrastructure (AWS, GCP, or Azure) and building systems that handle scale, large data volumes, low-latency requirements, and high availability.
- We encourage candidates to apply to the engineering role and level that best align with their experience.
- If you know you have what it takes, even if that's different from what we've described, be sure to explain why in your application.
- Experience building and operating backend systems in production, with meaningful experience in at least one of: search/retrieval, data pipelines, distributed systems, or API-heavy service architectures.
- Experience building or evaluating agentic / LLM-powered systems. You've worked with retrieval-augmented generation, multi-step agent workflows, or similar architectures and have thought critically about how to evaluate their output quality at scale.
- Strong software engineering fundamentals. You write clean, maintainable, well-tested code. You're comfortable with Python and have experience with backend frameworks, APIs, and production infrastructure. You care about reliability, observability, and CI/CD.
- Familiarity with search and retrieval systems. You've built or significantly improved retrieval pipelines and understand information retrieval fundamentals (hybrid retrieval, relevance tuning, query understanding). You've worked with tools likePGVector, Pinecone or Elasticsearch and understand their operational tradeoffs.
- You use AI coding tools to accelerate your own work. You've integrated tools like Copilot, Curssor, Claude Code, or similar into your development workflow and can speak to how they've changed the way you build software.
- Customer-oriented mindset. You've shipped features where you understood the end-user problem, not just the technical specification. You're motivated by customer impact, not just technical elegance.
- Ability to lead projects and provide technical direction. You can own a problem end to end, make sound architectural decisions, and help others on the team level up.
Nice to have
- Experience designing multi-agent systems or complex orchestration workflows.
- Contributions to AI/ML open-source projects.
- ML fundamentals such as precision, recall, cross-validation, bias-variance tradeoff, overfitting and regularization.
- Interest in sharing learnings externally (blog posts, talks, open-source contributions).
- Take ownership and run with ambiguous problems
- Bring scientific rigor while maintaining a pragmatic delivery focus
- See unclear requirements as an opportunity to shape the solution
- LLM platforms: OpenAI, Anthropic, Gemini
Skills
- 👋 KLUE ENGINEERING IS HIRING!
- Top-tier tools. All employees will receive a Mac (or PC, if that's your jam) and access to A+ tooling.
- Dog-friendly spaces. Bring your four-legged friend along in Vancouver or Toronto, as our offices are pup-approved.
Compensation
- We reward high performance and growth through career development, coaching, and annual performance reviews.
Benefits
- Extended health & dental coverage that starts on Day 1.
- Fun perks like discounts at Goodlife and Perkopolis are gravy.
- Ownership: All full-time employees have the opportunity to participate in our Employee Stock Option Plan.
- Our Vacation Policy is Take The Time You Need.
- We just ask that you give notice and don't leave your team hanging.
- We're a fast-growing, globally-distributed team based in Vancouver (with hubs like Toronto), scaling quicker than ever.
Company info
- You design retrieval pipelines, orchestration layers, and multi-step agent architectures that turn millions of competitive data points (news, press releases, webpage changes, Slack posts, emails, reviews, CRM data) into actionable intelligence for our customers.
- You're energized by understanding how customers use the product, and you use that context to prioritize what to build next.
- We're on a mission to help organizations stop losing winnable deals.
- We're a curious, collaborative team building a platform that helps companies compete with confidence, and we're looking for people who want to do meaningful work alongside others who care about craft and impact.
This listing is sourced directly from Klue's careers page and normalized into a canonical job model.