Modernizing Medicine

Machine Learning Engineer

Boca Raton, FL

Sponsorship not specifiedDetected 30 days ago

PythonDatabricksAWSCloud PlatformsCI/CDMachine LearningNLPAgentic AILangGraphComplianceDesign SystemsHIPAAEHR/EMRCommunicationCollaboration

About the role

A Culture of Excellence When you join ModMed, you're joining an award-winning team recognized for innovation and employee satisfaction.
PHISHING SCAM WARNING: ModMed is among several companies recently made aware of a phishing scam involving imposters posing as hiring managers recruiting via email, text and social media.
The imposters are creating misleading email accounts, conducting remote "interviews," and making fake job offers in order to collect personal and financial information from unsuspecting individuals.

Design and deploy multi-agent systems using frameworks such as LangGraph, AutoGen, CrewAI, or no-code/low-code agent frameworks to execute complex, non-linear clinical workflows.
Build and optimize conversational AI interfaces that handle message triage, sentiment analysis, and context-aware responses that are natural, empathetic, and patient-centric.
Develop tool-calling architectures that enable AI agents to interact with external APIs, EHR systems, and databases to perform real-world actions.
Design and implement evaluation frameworks to measure model and agent performance, including accuracy, reliability, safety, and task completion. Continuously improve systems using structured evaluation methodologies and feedback loops.
Implement robust evaluation pipelines and guardrails (e.g., NeMo Guardrails) to ensure agent safety, clinical accuracy, and HIPAA compliance.
Create and maintain dashboards to monitor agent reasoning traces, system performance, uptime, and task completion rates in production environments.
Proven experience building autonomous systems using LangGraph, AutoGen, CrewAI, or similar no-code/low-code agent frameworks.
Design and implement evaluation frameworks to measure model and agent performance, including accuracy, reliability, safety, and task completion.

Hands-on experience with fine-tuning models and implementing rigorous evaluation frameworks to ensure agent performance, safety, and reliability.
Familiarity with techniques for detecting hallucinations, bias, and failure modes in agent behavior.
Strong understanding of guardrails, alignment techniques, and safety mechanisms to ensure compliant, accurate, and trustworthy agent outputs in sensitive environments.
Strong proficiency in Python and experience with modern evaluation frameworks such as RAGAS or DeepEval.

401(k): ModMed provides a matching contribution each payday of 50% of your contribution deferred on up to 6% of your compensation.

At ModMed, we believe it's important to offer a competitive benefits package designed to meet the diverse needs of our growing workforce.
Comprehensive medical, dental, and vision benefits, including a company Health Savings Account contribution,
Generous Paid Time Off and Paid Parental Leave programs,
Company paid Life and Disability benefits, Flexible Spending Account, and Employee Assistance Programs,
Professional development opportunities, including tuition reimbursement programs and unlimited access to LinkedIn Learning,
Weekly catered breakfast and lunch, treadmill workstations, Zen, and wellness rooms within our BRIC headquarters.
3+ years of experience in Machine Learning with a strong focus on AI agents and conversational NLP systems.
Hands-on experience with AWS and Databricks, including building CI/CD pipelines for deploying machine learning models and AI agents.
Eligible Modernizers can enroll in a wide range of benefits:

Venture-Backed Company of the Year
We are growing fast, thinking big, and we are just getting started.
Ready to modernize medicine with us?
Additionally, ModMed will not ask you to purchase equipment or supplies as part of your onboarding process.

This listing is sourced directly from Modernizing Medicine's careers page and normalized into a canonical job model.