Dialpad
Sr. Software Development Engineer in Test
Vancouver, Canada · Senior
Sponsorship not specified$151k-$175kDetected 36 days ago
PythonJavaGoBackend DevelopmentGitRedisGCPCloud PlatformsKubernetesCI/CDGitHub ActionsJenkinsMachine LearningLLMsAgentic AIAI OrchestrationTest AutomationCommunicationCollaboration
About the role
- This position is based at one of Dialpad's Canadian offices and reports to a QA Eng Manager in the United States.
Responsibilities
- Own end-to-end quality for agentic features and workflows, including strategy, development, execution, and release qualification.
- Design and build automation tooling and frameworks for AI/LLM-driven systems, including prompt flows, agent orchestration, and tool integrations.
- Develop and maintain evaluation frameworks (evals) to measure response quality, accuracy, and hallucination rates.
- Build tooling for LLM observability and debugging, including prompt tracing and response analysis.
- Partner with Applied AI teams on prompt engineering, model selection, and evaluation strategies.
- Design and execute performance and load tests for AI services (latency, throughput, cost efficiency).
- Participate in design and architecture reviews to ensure systems are testable, observable, and resilient.
- Build and ship agentic AI products that are redefining how companies operate
Requirements
- 5+ years of experience in software engineering or SDET roles with an emphasis on software development.
- Demonstrated proficiency in coding with AI agents to accelerate development and improve code quality.
- Experience with CI/CD pipelines (e.g., Jenkins, GitHub Actions).
- Bachelor's degree in Computer Science or equivalent practical experience.
Skills
- About Dialpad
- Dialpad is the AI platform for customer experience, built to resolve customer problems in real time across voice and digital.
- Unlike legacy systems built to route and answer, or standalone agentic bot vendors built to deflect, Dialpad was built to resolve.
- Dialpad is backed by Andreessen Horowitz, GV, ICONIQ Capital, and T-Mobile.
- Being a Dialer
- At Dialpad, AI isn't just a feature; it's how our teams do their best work every day.
Compensation
- For exceptional talent based in British Columbia, Canada the target base salary range for this position is posted below.
Benefits
- Competitive salary, comprehensive benefits, and real opportunities for growth
- Drive automation coverage (80%+ for critical AI workflows) using deterministic + probabilistic validation approaches.
Apply directly at Dialpad →Create a free account for alerts like thisView Dialpad immigration profile
This listing is sourced directly from Dialpad's careers page and normalized into a canonical job model.