Ellipsis Health
Senior Data Scientist
San Francisco - Hybrid · Senior
Stay score
odds of building a lasting career here
Sponsors, but it's cap-subject — you still face the weighted lottery (~61% per draw at Level IV). Good if you win; have a cap-exempt backup on your list.
Lottery odds assume a STEM candidate.
Personalize to your clock →H-1B wage level
the lottery is wage-weighted — each level is one more entry
$26,565 more — $206,565 — moves this role to Level IV and 4 lottery entries. That figure is inside the range the employer already advertised.
Based on the DOL prevailing wage for this occupation and worksite, a base salary of $206,565 would place this position at wage Level IV. That figure is within the posted range, and I'd like to target it. This role classifies under "Data Scientists" for prevailing-wage purposes.
DOL prevailing wage, 2026-27 wage year · Data Scientists (15-2051) · San Francisco-Oakland-Fremont, CA. Wage level is derived by USCIS from the offered wage, occupation and worksite; the occupation shown is inferred from the job title.
Employer immigration record
from this employer's Department of Labor filings
Files H-1B transfers
Sourced from Department of Labor LCA, PERM and prevailing-wage disclosure data. Employer matching is by name, so figures may be split across an employer's legal entities. Absence of a filing means none appears in our copy of the data, not that none exists.
Community outcomes
No reports yet — be the first to help the next applicant.
About the role
- Ellipsis Health is creating cutting-edge AI/ML products that solve healthcare staffing issues and administrative burdens using conversational AI and our patented voice biomarker technology in the delivery of better healthcare for everyone.
- As a Data Scientist specializing in AI Quality & Evaluation, you will play a pivotal role in ensuring the robustness, accuracy, and fairness of our AI models and systems.
- Your work will directly contribute to accelerating customer onboarding and enhancing the overall user experience.
Responsibilities
- Drive High-Impact Projects: Own data science and AI evaluation projects end-to-end-from defining the problem and developing the methodology to executing the analysis, communicating results, and driving implementation.
- Drive Continuous Improvement of LLM-as-a-Judge: Build the data and evaluation infrastructure for a closed-loop AI quality system, including golden datasets, ground-truth benchmarks, judge calibration, error analysis, and production feedback.
- Develop Evaluation Frameworks: Design and implement robust evaluation frameworks, methodologies, and metrics for LLM- and speech-based AI systems. Develop scalable approaches that help us measure quality and accelerate customer onboarding.
- Build and Manage Evaluation Datasets: Design, curate, and maintain high-quality datasets for training, testing, benchmarking, and evaluating conversational AI systems and their components.
- Create and Manage Data Pipelines and Dashboards: Build and maintain scalable data pipelines and intuitive dashboards that enable reliable data analysis,ongoing AI quality monitoring, and data-driven decision-making across the organization.
- Collaborate and Innovate: Work closely with AI/ML Engineers and Product Managers to integrate your findings into product enhancements.
- Mentor and Lead: Mentor junior data scientists, establish best practices, and raise the technical bar across the team.
- You will be instrumental in developing comprehensive evaluation frameworks, creating diverse and high-quality datasets, and implementing metrics to drive continuous improvement across our AI initiatives.
Requirements
- Bachelor's or Master's degree in Computer Science, Data Science, Statistics, Mathematics, or a related quantitative field.
- Strong proficiency in programming languages such as Python (with libraries like Pydantic, Pandas, NumPy, Scikit-learn).
- Experience working with large-scale datasets, data pipelines, and analytical tools to generate actionable insights.
- Familiarity with evaluation metrics (precision, recall, agreement metrics like Cohen's Kappa) to calibrate judge models against human ground truth.
- Experience with Natural Language Processing (NLP) techniques and understanding of LLM architectures and their evaluation challenges.
- Experience with Speech Technologies and their evaluation is a significant advantage.
- Familiarity with data governance principles, particularly concerning PII/PHI.
- Experience with MLOps practices and deploying models to production.
- Familiarity with Langfuse, cloud platforms (GCP, AWS, Azure) and data platforms such as Databricks.
- 5+ years of industry experience in data science, machine learning, or a related quantitative field.
- Strong foundation in statistical analysis, experimental design, hypothesis testing, and A/B testing methodologies.
- Demonstrated ability to independently own and drive projects from problem definition through execution and implementation..
- Excellent communication and interpersonal skills, with the ability to collaborate effectively with AI/ML Engineers, Product Managers, and other cross-functional stakeholders in a fast-paced environment.
- Bonus Points If You Have:
- Experience in a regulated industry (e.g., healthcare, finance). Familiarity with data governance principles, particularly concerning PII/PHI.
Compensation
- Salary and Benefits
Benefits
- Experience in a regulated industry (e.g., healthcare, finance).
Company info
- We are headquartered in Silicon Valley and are funded and supported by some of the most preeminent venture capital teams.
- Ellipsis Health is located in the San Francisco Bay Area, but we are open to remote candidates for this role, as long as they are located in the U.S.
This listing is sourced directly from Ellipsis Health's careers page and normalized into a canonical job model.