Abby Care
Senior Applied AI Engineer
San Francisco · Senior · Full-time
Sponsorship not specifiedDetected 55 days ago
Machine LearningA/B TestingDesign SystemsLeadershipMentoring
About the role
- High-agency and pragmatic, you are comfortable operating in ambiguity, moving between experimentation and production engineering, and owning technically complex systems end to end.
- If you are excited to apply frontier AI capabilities to difficult, high-impact problems while transforming care in the home, we'd love to hear from you!
- This is a full-time hybrid opportunity based in San Francisco, California, with four days per week in person.
Responsibilities
- Lead initiatives from workflow discovery and technical design through production deployment, iteration, and measurable business or care outcomes.
- Design systems that handle incomplete information, conflicting evidence, changing requirements, and operational edge cases by combining models, retrieval, rules, state machines, and human oversight.
- Create representative datasets, evaluation harnesses, production tracing, confidence-based escalation, and systematic error-analysis processes.
- Partner with Product, Design, Clinical, Operations, Analytics, Platform, and System of Record engineers to ensure AI capabilities solve real problems rather than remain isolated prototypes.
- Reporting to the Applied AI Leader, you will own major initiatives from initial problem definition through production deployment and measurable impact.
- You will work closely with product engineers, product managers, designers, clinicians, operators, and analysts to ensure that the systems you build reflect real-world workflows and produce meaningful outcomes.
- Own high-impact AI systems end to end: Lead initiatives from workflow discovery and technical design through production deployment, iteration, and measurable business or care outcomes.
- Engineer for real-world complexity: Design systems that handle incomplete information, conflicting evidence, changing requirements, and operational edge cases by combining models, retrieval, rules, state machines, and human oversight.
- Build rigorous evaluation and monitoring: Create representative datasets, evaluation harnesses, production tracing, confidence-based escalation, and systematic error-analysis processes.
- Integrate AI into complete workflows: Partner with Product, Design, Clinical, Operations, Analytics, Platform, and System of Record engineers to ensure AI capabilities solve real problems rather than remain isolated prototypes.
Requirements
- You will determine how workflows should be decomposed, what context and tools an AI system needs, how its behavior should be evaluated, where deterministic controls are required, and when a human must intervene.
Nice to have
- AI behavior is supported by representative evaluations, systematic error analysis, and clear production monitoring.
- Your systems respond safely to uncertainty through confidence handling, escalation, and human approval where appropriate.
- AI capabilities are integrated into end-to-end product and operational workflows rather than remaining isolated prototypes.
- You help other engineers make better architectural and implementation decisions through technical leadership and mentorship.
- Strong hands-on experience with language models, retrieval systems, structured generation, model APIs, or agent architectures.
- Strong software engineering fundamentals, including backend systems, APIs, data modeling, testing, and observability.
- Experience designing evaluations and analyzing the behavior of probabilistic systems.
- Strong judgment about where AI is appropriate and where deterministic approaches or human review are required.
Compensation
- Competitive compensation packages that reflect the value you bring.
Benefits
- Comprehensive health coverage that works for you.
- Choose from high-quality medical dental and vision options, including a $0 deductible PPO and a company-funded HSA, alongside employer-paid life and disability insurance.
- Generous paid time off.
- Financial savings benefits to support your future.
- We support your financial well-being with HSA contributions, optional FSA and commuter benefits, and full coverage of all 401(k) account fees (employer match not currently offered).
- Paid parental leave to support your growing family.
- We provide paid leave, so you can focus on bonding and adjusting to life as your family grows.
- Redefining healthcare starts with how we treat the parents and children we serve.
Company info
- We take our mission seriously while never losing sight of the people behind the work.
Apply directly at Abby Care →Create a free account for alerts like thisView Abby Care immigration profile
This listing is sourced directly from Abby Care's careers page and normalized into a canonical job model.