Ellipsis Health
Senior ML Engineer, Agentic AI
San Francisco - Hybrid · Senior
Sponsorship not specified$160k-$210kDetected 44 days ago
PythonDistributed SystemsData StructuresAlgorithmsMachine LearningDeep LearningTensorFlowPyTorchLLMsAgentic AIStatisticsResearchLeadershipCollaborationMentoring
About the role
- In this role, you will be a core contributor and technical leader within our AI Research & Engineering team.
- The typical salary range for this role is $160,000 to $210,000 USD, depending on skills, qualifications, and relevant experience.
- BACKGROUND CHECKS: As a health technology company, we reserve the right to run background checks on candidates to whom we extend offers, in compliance with applicable laws.
Responsibilities
- Advanced Agentic Architecture: Design, build, and optimize scalable systems and orchestration pipelines capable of deep multi-step reasoning, dynamic memory allocation, long-context evaluation, and high-fidelity tool utilization.
- Rigorous Evaluation & Benchmarking: Architect and maintain multi-dimensional quantitative evaluation frameworks and continuous testing infrastructure.
- Implement state-of-the-art LLM-as-a-judge rubrics, and statistical tracking to evaluate agent capabilities and guarantee zero-regression product updates.
- Data Mix Optimization: Develop and scale automated data curation pipelines to extract, filter, and structure user feedback signals, execution logs, and expert labels into ultra-high-quality training datasets for model fine-tuning.
- Mentorship & Engineering Excellence: Foster a culture of technical rigor by setting high coding standards, leading design reviews, standardizing tooling, and mentoring other ML and software engineers across the team.
- Design, build, and optimize scalable systems and orchestration pipelines capable of deep multi-step reasoning, dynamic memory allocation, long-context evaluation, and high-fidelity tool utilization.
- Implement and adapt state-of-the-art techniques in post-training fine-tuning, preference alignment, and automated prompt optimization.
- Develop and scale automated data curation pipelines to extract, filter, and structure user feedback signals, execution logs, and expert labels into ultra-high-quality training datasets for model fine-tuning.
- Foster a culture of technical rigor by setting high coding standards, leading design reviews, standardizing tooling, and mentoring other ML and software engineers across the team.
- Operating at the sweet spot between cutting-edge scientific research and production-grade systems, you will drive the conceptualization, architecture, and deployment of frontier agentic systems.
Requirements
- Proven track record of architecting, implementing, and deploying complex LLM-powered applications, multi-agent orchestrations, or autonomous systems in a production environment.
Nice to have
- 8+ years of industry experience specializing in advanced data structures, algorithms, distributed systems, and heavy-duty scalable ML infrastructure.
- 3+ years of technical leadership experience, including leading complex technical project workstreams, defining organizational engineering directions, or directly mentoring technical talent.
- We evaluate candidates holistically and comply with all "ban the box" regulations.
Compensation
- The typical salary range for this role is $160,000 to $210,000 USD, depending on skills, qualifications, and relevant experience.
Benefits
- We offer competitive salary and benefits, including 401(k) matching, health, vision, and dental insurance, and very flexible paid time off.
- As a health technology company, we reserve the right to run background checks on candidates to whom we extend offers, in compliance with applicable laws.
- If you have a disability or require accommodations during the application or recruitment process, please contact careers@ellipsishealth.com.
- Technical Leadership & Vision: Act as the technical authority for the Agentic AI roadmap, steering engineering pods from initial research prototyping through to production scale.
- Research-to-Production Translation: Bridge the gap between frontier machine learning research and enterprise software design.
- Bachelor's degree in Computer Science, Machine Learning, Statistics, Engineering, or equivalent practical experience.
- Advanced programming proficiency in Python and deep hands-on expertise with distributed machine learning or deep learning frameworks (e.g., PyTorch, JAX, or TensorFlow).
- Master's degree or PhD in Computer Science, Artificial Intelligence, Machine Learning, or a related quantitative technical field.
- Experience working within complex, highly collaborative matrixed organizations on high-acuity, deeply regulated technical integrations (e.g., healthcare, fintech, or aerospace).
Company info
- We are headquartered in Silicon Valley and are funded and supported by some of the most preeminent venture capital teams.
Apply directly at Ellipsis Health →Create a free account for alerts like thisView Ellipsis Health immigration profile
This listing is sourced directly from Ellipsis Health's careers page and normalized into a canonical job model.