HappyRobot
Data Scientist
San Francisco
Sponsorship not specifiedDetected 8 days ago
SQLMachine LearningData ScienceNLPComputer VisionLLMsAgentic AIStatisticsA/B TestingComplianceLogisticsExperimental DesignCommunication
About the role
- You'll work closely with Product, Engineering, and Machine Learning teams to measure how changes to our models, agents, and product features affect real-world performance.
- Your work will range from evaluating A/B tests and model changes to analyzing millions of conversations and workflows.
- You'll turn complex data into clear insights that influence our product and ML roadmaps.
Responsibilities
- Design, run, and interpret A/B tests for model changes, prompts, agent behavior, workflows, and product features.
- Investigate anomalies and regressions, perform root-cause analyses, and recommend improvements.
- Build statistical models, simulations, and analytical frameworks to support product and ML decisions.
- Partner with Engineering to improve instrumentation, data quality, experimentation systems, and analytical data models.
- Build dashboards and self-serve tools that help teams understand product and agent performance.
- HappyRobot is the infrastructure for enterprises to build and orchestrate AI workforces.
- We started in logistics, built our own voice stack, models, and orchestration layer from the ground up, and are now bringing that infrastructure to every enterprise that runs the real economy.
Requirements
- 4+ years of experience in Data Science, Product Analytics, or another highly quantitative product role.
- Strong experience with experimental design, A/B testing, statistics, causal inference, and hypothesis-driven analysis.
- Advanced proficiency in SQL and Python.
- Experience defining and operationalizing product and feature metrics.
- Ability to translate ambiguous product questions into rigorous analyses and actionable recommendations.
- Strong product instincts and the ability to distinguish statistical significance from meaningful product or customer impact.
Nice to have
- Experience working with large language models, AI agents, generative AI, or other probabilistic ML products.
- Experience measuring the production impact of model, prompt, retrieval, or orchestration changes.
- Familiarity with ML evaluation systems and the relationship between offline evaluations and online metrics.
- Experience analyzing conversational, NLP, speech, or other unstructured data.
- Experience with enterprise or B2B products.
- Experience combining quantitative analysis with qualitative methods such as conversation reviews, customer feedback, surveys, or user research.
- Familiarity with modern analytics infrastructure, data warehouses, experimentation platforms, and business intelligence tools.
- Prior experience in a fast-growing startup or other highly ambiguous environment.
Compensation
- Top-Tier Compensation - Competitive salary + equity in a high-growth startup.
Benefits
- Learn more about our vision in our manifesto. https://www.happyrobot.ai/blog/manifesto
Apply directly at HappyRobot →Create a free account for alerts like thisView HappyRobot immigration profile
This listing is sourced directly from HappyRobot's careers page and normalized into a canonical job model.