Wizardcommerce
AI Applied Scientist
Remote - USA
Sponsorship not specified$225k-$280kDetected 62 days ago
Machine LearningLLMsRAGA/B TestingResearchLeadershipCommunication
About the role
- This role sits at the intersection of applied ML, evaluation science, and product.
- is bring scientific rigor to the most important question at Wizard: is our agent getting better, and how do we know?
- This is a foundational hire on our science team.
Responsibilities
- Design and run experiments to measure improvements and regressions
- Build and maintain evaluation datasets, benchmarks, and scoring frameworks
- Partner with ML Engineers to validate model changes and guide iteration
- Identify failure modes and edge cases, and drive improvements through data
- Build relationships with ML, AI Engineering, and Product
Nice to have
- As the agent gets more capable, the science problems get richer
- 5+ years in Applied ML, AI Research, or Applied Science (PhD or equivalent depth strongly preferred)
Skills
- Run experiments that influence at least one significant model or product change
- Stand up automated evaluation the team trusts before and after every launch
- Influence team-level strategy on what we measure, what we improve, and why
- Mentor and help grow the science function as it expands
- Clear, trusted accuracy metrics are consistently used across product and engineering
- A robust automated evaluation framework for both offline and live experiments
- Model and product changes are consistently measured before and after launch
- Demonstrable improvements in LLM judge quality and eval coverage
Compensation
- Fully remote work within the United States
- Periodic company offsites and team gatherings
- The expected base salary range for this role is $225,000 - $280,000 USD, and will vary based on skills, experience, role level, and geographic location.
- Final compensation will be determined by considering these factors alongside overall role scope and responsibilities.
- In addition to base salary, Wizard offers:
- Wizard is committed to fair, transparent, and competitive compensation practices.
Benefits
- Equity in the form of stock options
- Medical, dental, and vision coverage
- Flexible PTO and company holidays
Apply directly at Wizardcommerce →Create a free account for alerts like thisView Wizardcommerce immigration profile
This listing is sourced directly from Wizardcommerce's careers page and normalized into a canonical job model.