Function Health

Function Health

Senior Applied AI Engineer

Austin, USA · Senior

Sponsorship not specifiedDetected 41 days ago
PythonGoFastAPIFlaskFull-Stack DevelopmentGitPostgreSQLVector DatabasesAWSDockerKubernetesTerraformCI/CDGitHub ActionsSite Reliability EngineeringAPI DevelopmentMachine LearningLLMsRAGAgentic AILangGraphComplianceExcelTest Automation

About the role

  • We are redefining how individuals understand, measure, and improve their health by moving beyond the limitations of traditional care and enabling comprehensive, continuous insight into human biology.
  • Function has been recognized as one of Fast Company's Most Innovative Companies of 2024, and is venture-backed by Redpoint and other leading venture firms.
  • Over half a million members have joined Function to take control of their health.

Responsibilities

  • Architect and build stateful, graph-based agent workflows with tool use, planning, and memory.
  • Own production readiness: tracing, logging, metrics, rate limiting, circuit breakers, and SLOs Stand up eval pipelines: offline golden sets, LLM-as-judge with human rubrics, online A/B, and regression tests in CI.
  • Optimize cost/latency: model routing, prompt and tool selection, quantization, and KV cache/prefill strategies.
  • Partner cross-functionally to translate research into robust production systems and iterate quickly behind evaluation gates.
  • Mentor engineers through design docs and architecture decisions.
  • Qualifications/Skills: To excel in this role, candidates must bring a unique combination of skills and experiences: 1+ years building agentic AI systems; 6+ years as a full-stack or ML engineer, building production backends or ML systems in Python, Go, or similar.
  • Strong with API design and backend frameworks (FastAPI, Flask) and event-driven architectures.
  • Day to day, that means building and operating production multi-agent systems end to end: orchestration graphs, tool use and memory, retrieval over a member's records, and the evals and observability to keep it reliable.
  • At Function, we celebrate diversity and are committed to building a diverse and inclusive workforce.

Requirements

  • Experience with consumer-scale AI apps, high-traffic systems, or on-device/edge acceleration (WebGPU).
  • We prioritize clinical precision - data must be right.

Skills

  • Fluency with agentic orchestration ( e.g., LangGraph, PydanticAI, DSPy, LlamaIndex ) and tool/function calling.
  • Experience integrating frontier LLMs and multimodal models via managed APIs or self-hosted serving.
  • Data systems expertise with PostgreSQL, including token streaming and throughput tuning.
  • Retrieval and memory: vector databases (pgvector, Pinecone, Weaviate, Milvus), hybrid search, and graph/knowledge storage.
  • Observability and SRE: OpenTelemetry traces, metrics, structured logs, SLOs, dashboards, and on-call triage.
  • Cloud-native delivery: Kubernetes, Terraform, Docker, GPU scheduling/autoscaling on AWS or GCP.
  • CI/CD proficiency with GitHub Actions and test automation for prompts, tools, and agents.
  • Clear, concise communication and high ownership in fast-paced environments.
  • Nice to Haves: Real-time multimodal systems: streaming ASR, low-latency TTS, WebRTC, and vision pipelines.
  • RAG expertise beyond basics: Graph RAG, multi-hop retrieval, sub-agents, query planning, and freshness policies.
  • Regulated data experience (HIPAA, SOC 2, GDPR) and data residency controls.
  • Personalization at inference time, long-term memory agents, session state, and episodic memory stores.

Benefits

  • You'll own the agentic system that turns a member's health data into clear next steps, working alongside their clinicians.
  • You'll wire frontier LLMs into Function's proprietary data, and hold the whole thing to the safety, latency, and cost controls healthcare demands.
  • Turn our longitudinal health dataset into decisions, not dashboards, so members act on their health rather than just view it.
  • Real-time multimodal systems: streaming ASR, low-latency TTS, WebRTC, and vision pipelines.
  • We value our team at Function and offer a competitive salary and benefits package, flexible working hours, and a dynamic work environment where creativity and innovation are encouraged.
  • Build high-reliability APIs and streaming services for real-time inference, speech, and vision.

Company info

  • We are aligned in purpose, prioritization, and speed.
  • We gather diverse perspectives to make informed decisions.
  • We clear paths for each other and move fast together.
  • We communicate clearly and respectfully, rallying around shared goals.
  • We are ruthlessly aligned to our mission - and leave ego at the door.
  • We disagree and commit.
  • We don't tolerate politics or withholding information.
  • We operate with honesty, transparency, and respect.
Apply directly at Function Health →Create a free account for alerts like thisView Function Health immigration profile

This listing is sourced directly from Function Health's careers page and normalized into a canonical job model.