Modern Fertility

Senior AI Engineer

New York, NY · Senior

Sponsorship not specified$182k-$220kDetected 25 days ago

PythonBackend DevelopmentFull-Stack DevelopmentCode ReviewVector DatabasesLLMsRAGLLMOpsLangGraphAI OrchestrationLogisticsEHR/EMRLeadershipMentoring

About the role

Ro is building a team focused on shipping LLM-powered products across the patient experience, clinical operations, and internal tooling.
We're hiring a Senior AI Engineer to join a new team we're building from the ground up alongside a Senior AI Lead and an Engineering Manager.
You'll own AI features from prototype through production and spend as much time improving workflows with clinical operators as writing code.

Design, build, and ship production LLM powered features end-to-end.
Build the AI application layer, including prompt orchestration, tool calling, retrieval (RAG), embeddings, agent workflows, and structured outputs.
Develop evaluation infrastructure, including regression suites, LLM-as-a-judge evaluations, synthetic datasets, human review workflows, and quality metrics that catch regressions before users do.
Design observability systems that measure accuracy, latency, cost, hallucination rates, and model behavior in production.
Build safety and reliability guardrails that ensure AI systems meet quality, compliance, and operational requirements.
and make pragmatic build-versus-buy decisions.
Raise engineering standards across the team through technical leadership, code reviews, mentorship, and thoughtful system design.
5+ years building production software, with at least 1-2 years building and deploying LLM-powered applications in production (or equivalent depth through substantial side projects or open-source work).
Strong Python engineer with experience building backend services and integrating modern AI APIs and frameworks.
We're building a new system.

A note on reporting structure This is a new function at Ro, and we're being deliberate about not over-defining it.
Your manager and where you sit on the org chart will depend on the specific shape of the team we end up with.
We'd rather find the right people and figure out the lines around them than pre-draw boxes and miss great candidates.
These considerations may cause your compensation to vary.

If that ambiguity is a deal-breaker, this isn't the right role; if it sounds like an opportunity, we want to talk. - The target base salary for this position ranges from $182,300 to $220,000, in addition to a competitive equity and benefits

Join Tech @ Ro to build the future of healthcare, from the ground up!
At Ro, we believe that when people achieve their health goals, they can achieve their life goals.
The highest-leverage way to move society forward is to give people their health, and the current healthcare system isn't built to do that.
We've built a vertically integrated healthcare platform that connects telehealth, diagnostics, pharmacy, and logistics into a seamless, end-to-end experience for millions of patients.
Ro is consistently recognized as a top workplace in Health Care, in New York, and for Women and Parents-earning more than 20 honors from Fortune, Great Place to Work, and PEOPLE since 2021.
In 2025 alone, we ranked top 5 among medium workplaces in Health Care and New York, and top 50 nationwide.
At Ro, we believe that our diverse perspectives are our biggest strengths - and that embracing them will create real change in healthcare.

If you require a reasonable accommodation in the application or interview process, please contact us at talent@ro.co.

This listing is sourced directly from Modern Fertility's careers page and normalized into a canonical job model.