Jobber
Data Scientist
Toronto
Sponsorship not specifiedDetected 48 days ago
PythonSQLSnowflakeCI/CDMachine LearningDeep LearningTensorFlowPyTorchscikit-learnPandasData ScienceLLMsMLOpsA/B TestingExcelManual TestingLeadershipCommunicationCollaborationMentoringPublic Speaking
About the role
- Monitor models in production using statistical process control, drift detection, and alerting pipelines; proactively surface issues before they impact customers.
- Stay current with advancements in LLM evaluation techniques, AI safety, and model observability, and apply emerging best practices to our workflows.
- Communicate findings clearly and concisely to stakeholders, translating model performance signals into actionable recommendations.
Responsibilities
- Build and own regression test suites for ML and LLM models, catching performance regressions and unexpected behaviour across model updates and data drift scenarios.
- Develop and execute MCP evaluations, systematically assessing model capabilities, edge cases, and failure modes across relevant business contexts.
- Collaborate with senior data scientists to contribute to the design and refinement of ML model architectures, offering feedback grounded in validation results.
- We believe great collaboration is intentional, and sometimes that means coming together in person to build, brainstorm, and connect.
- To support this, the role is open to candidates based in one of our hub cities: Edmonton, Toronto, Vancouver, or Kitchener-Waterloo.
Requirements
- Experience with LLM evaluation frameworks (e.g. RAGAS, Eleuther AI Eval Harness, or custom LLM eval pipelines).
- Strong understanding of ML and LLM model architectures - you can reason about how a model is built and why it behaves the way it does.
- High proficiency in SQL for data exploration, feature validation, and debugging model inputs.
- Familiarity with Snowpark (Python) for running data transformations and ML workflows directly within Snowflake.
- Familiarity with prompt engineering and evaluation strategies for LLM-powered features.
- Experience working in a SaaS environment and an appreciation for how model quality translates to customer impact.
Skills
- Strong written and verbal communication skills; comfortable presenting findings to both technical peers and non-technical stakeholders.
Compensation
- At Jobber, we believe that compensation should be transparent, fair, and reflective of your experience and growth.
- This role has a minimum annual salary of $125,800 CAD, a midpoint of $147,900 CAD, and a maximum of $170,100 CAD, designed to reflect progression from strong foundational skills to deep expertise in ML validation and evaluation.
- We design our compensation to reflect each new hire's skills, experience, and the complexity of the role, ensuring a fair and competitive salary.
- Our range is intentionally broad to support growth and long-term impact, with fully established hires typically starting around the midpoint.
- Base salary is just one part of a total compensation package that includes equity rewards, annual stipends for health and wellness, retirement savings matching, and an extended health package with fully paid premiums for body and mind.
- Your professional growth matters to us too - you'll have access to a dedicated talent development program that includes career coaching and opportunities for career development.
Benefits
- A total compensation package that includes an extended health benefits package with fully paid premiums for both body and mind, matching in RRSP, TFSA or FHSA, and stock options.
- A dedicated Talent Development team and access to coaching, learning, and leadership programs to help you grow your career, reach your goals, and unlock your full potential.
- A unique opportunity to build, grow, and leave your impact on a $400-billion industry that has no dominant player...yet.
- Document evaluation methodologies, test results, and monitoring runbooks clearly enough that stakeholders across technical and business teams can understand model health.
Company info
- be humble, be supportive, and give a shit, which are not just said but are lived.
- We work in a collaborative environment where teams make decisions with autonomy and contribute directly to shaping the company's future.
- Job by job, we're transforming the way service is delivered.
- Your lawn care provider, home cleaning service, plumber or painter could use Jobber to better connect with their customers, save time in the office, invoice faster, and get paid!
- We're bringing tens of thousands of people together with technology to deliver billions of dollars a year in services to happy customers.
- Jobber exists to help make these small businesses successful, and when they're successful we all win!
- Similar to how Jobber empowers small businesses with the tools and insights they need to succeed, the Strategy and Analytics Department ensures our people at Jobber have the tooling, data insights, and strategic direction to excel in our shared mission.
- We turn data into actionable insights, and critical business needs into impactful software, working with multiple teams and departments across the company.
- Strategy & Analytics serves as a central hub that drives business outcomes in all corners of Jobber's ecosystem.
- To work with a group of people who are humble, supportive, and give a sh*t about our customers.
Equal opportunity
- We are an equal opportunity employer, and we are committed to working with applicants requesting accommodation at any stage of the hiring process.
This listing is sourced directly from Jobber's careers page and normalized into a canonical job model.