V Soft Consulting Group Inc.

V Soft Consulting Group Inc.

EIS QA Engineer II

Ontario, San Bernardino County · Mid

Sponsorship not specifiedDetected 6 days ago
PythoniOSAndroidRESTMachine LearningData AnalysisComputer VisionJiraProcess ImprovementSeleniumCypressPlaywrightTest AutomationCommunication

About the role

  • EIS QA Engineer II (Hybrid) Primary Location: Mississauga, Ontario V-Soft Consulting is currently hiring for an EIS QA Engineer II for our premier client in Mississauga, Ontario.
  • Education and Experience » Proven experience in a quality assurance, testing, or data analysis role, preferably within the AI/ML domain.
  • A deep understanding of the machine learning lifecycle and the common failure modes of AI models.

Responsibilities

  • Evaluation Strategy & Benchmark Development: Design, develop, and maintain a comprehensive suite of test cases and evaluation benchmarks.
  • Data Sourcing & Curation: Source, curate, and manage high-quality datasets for model evaluation and testing.
  • Exploratory & Adversarial Testing (Red Teaming): Perform unscripted, exploratory testing to discover unexpected model behaviors.
  • Test Environment Management: Set up, maintain, and troubleshoot testing and demonstration environments to ensure a stable and reliable evaluation pipeline.
  • Job Responsibilities: Evaluation Strategy & Benchmark Development: Design, develop, and maintain a comprehensive suite of test cases and evaluation benchmarks.
  • Design, develop, and maintain a comprehensive suite of test cases and evaluation benchmarks.
  • Source, curate, and manage high-quality datasets for model evaluation and testing.
  • Set up, maintain, and troubleshoot testing and demonstration environments to ensure a stable and reliable evaluation pipeline.
  • Excellent communication skills, with the ability to clearly document bugs and articulate complex technical issues.

Requirements

  • Hands-on experience with data annotation, data validation, and managing large datasets.
  • Experience with bug tracking systems (e.g., Jira) and test case management tools.

Benefits

  • Familiarity with computer vision or other specific AI domains relevant to our work.
  • As a valued V-Soft Consultant, you're eligible for full benefits (Medical, Dental, Vision), a 401(k) plan, competitive compensation and more.

This listing is sourced directly from V Soft Consulting Group Inc.'s careers page and normalized into a canonical job model.