Modmed
Staff AI Engineer
Boca Raton, FL · Staff+
Sponsorship not specifiedDetected 7 days ago
AlgorithmsVector DatabasesCloud PlatformsMachine LearningLLMsRAGAgentic AILLMOpsAI OrchestrationIncident ResponseEHR/EMRLeadershipCommunicationCollaborationMentoring
About the role
- A Culture of Excellence When you join ModMed, you're joining an award-winning team recognized for innovation and employee satisfaction.
- You set direction for multi-agent orchestration, production RAG (hybrid search, re-ranking, and query routing), tool and MCP integration, and the evaluation and observability stack that keeps them dependable.
- You mentor senior engineers and represent AI engineering in cross-functional and strategic initiatives.
Responsibilities
- Define and drive technical direction for AI and agentic systems, and contribute to the AI platform roadmap across teams
- Lead the design of large-scale AI/LLM systems: inference platforms, APIs, and distributed architectures
- Define and drive best practices and standards for AI/LLM systems across teams (agent design, evaluation, observability, reliability)
- Lead complex production debugging and incident response across teams, and harden the resulting fixes into platform guardrails
- Lead technical design reviews and architecture decision records (ADRs) for critical AI infrastructure
- Lead multi-agent platform architecture decisions: runtime selection, orchestration patterns, and enterprise integration strategy
- Drive LLM cost optimization at scale: model routing, caching, batching, token budget management, and provider cost analysis
- Experience building rigorous evaluation for non-deterministic AI systems, including statistical methods (such as bootstrap confidence intervals and minimum effect-size thresholds) to separate genuine quality changes from run-to-run model variance
- Experience building AI/LLM systems or platform components from the ground up
Requirements
- Master's or Ph.D. degree in Computer Science, Software Engineering, or a related field.
- 10+ years of professional experience in ML/AI or software engineering, including 4+ years in senior or staff-level roles with production system ownership
- Hands-on experience architecting and operating production agentic AI or LLM systems (multi-agent workflows, production RAG, tool and MCP integration)
- Track record of conference talks, published papers, or significant open-source contributions
- Experience with GPU-accelerated inference and model serving optimization
- Familiarity with workflow orchestration and streaming architectures for real-time AI
- Demonstrated engineering leadership, including driving technical strategy and influencing cross-team decisions
Skills
- Consistently ranked as a Top Place to Work
- 2025
- Mentor senior engineers and emerging technical leaders, raising the engineering bar
- Contribute to capacity planning and cost optimization strategies for AI/LLM infrastructure
- Define and drive vector database and
- evaluate and standardize frameworks, tooling, and deployment patterns for agentic AI
- Proven mentorship of mid-level and senior engineers
- Strong communication skills for executive and cross-functional audiences
Compensation
- 401(k): ModMed provides a matching contribution each payday of 50% of your contribution deferred on up to 6% of your compensation.
Benefits
- At ModMed, we believe it's important to offer a competitive benefits package designed to meet the diverse needs of our growing workforce.
- Comprehensive medical, dental, and vision benefits, including a company Health Savings Account contribution,
- Generous Paid Time Off and Paid Parental Leave programs,
- Company paid Life and Disability benefits, Flexible Spending Account, and Employee Assistance Programs,
- Professional development opportunities, including tuition reimbursement programs and unlimited access to LinkedIn Learning,
- Weekly catered breakfast and lunch, treadmill workstations, Zen, and wellness rooms within our BRIC headquarters.
- Experience in Healthcare, FinTech, or other regulated industries
Company info
- Venture-Backed Company of the Year
- We are growing fast, thinking big, and we are just getting started.
- Ready to modernize medicine with us?
- Additionally, ModMed will not ask you to purchase equipment or supplies as part of your onboarding process.
This listing is sourced directly from Modmed's careers page and normalized into a canonical job model.