Arbiter AI

Arbiter AI

Staff Backend AI Engineer

Remote, US · Staff+

Sponsorship not specified$190k-$250kDetected 28 days ago
PythonDistributed SystemsBackend DevelopmentGitAWSGCPAzureCloud PlatformsCI/CDRESTgRPCLLMsAgentic AILeadershipCommunicationCollaborationMentoring

About the role

  • Arbiter is the AI-powered care orchestration system that unites healthcare.
  • This role can be remote or onsite, based in our New York City or Boca Raton offices, in a fast-paced, collaborative environment where great ideas move quickly from whiteboard to production.
  • Pay Transparency The annual base salary range for this position is $190,000-$250,000.

Responsibilities

  • As a Staff Backend AI Engineer, you will design, build, and operate the backend AI systems that power Arbiter's intelligent care orchestration platform.
  • Owning critical parts of our agentic infrastructure, from low-latency inference pipelines to workflow automation and service orchestration, working closely with product, data, and clinical partners to ship production-grade AI systems with real customer dependency.
  • Build The Agentic Platform: Design, develop, and operate the backend systems that power Arbiter's agent-driven care orchestration workflows, including service orchestration, inference pipelines, and automation primitives.
  • Production AI Systems: Ship and maintain production-grade AI systems that automate complex clinical and administrative workflows, with real customer dependency and strict reliability, latency, and correctness requirements.
  • Platform Architecture & Scalability: Contribute to the architectural design of Arbiter's AI-driven platform, emphasizing modularity, extensibility, scalability, and clean integration with EMRs, data systems, and external services.
  • Inference & Backend Reliability: Ensure high performance, low latency, and fault tolerance across backend services and AI inference pipelines through strong system design, monitoring, and operational best practices.
  • Infrastructure & Deployment Excellence: Implement and uphold best practices for CI/CD, testing, observability, and deployment of backend and AI systems in production environments.
  • Cross-Functional Execution: Partner closely with data scientists, product managers, clinical experts, and other engineers to translate ambiguous, high-impact problems into scalable technical solutions.
  • Taking immense pride in our technical craft and the products we build, treating both with utmost respect and care.
  • Design, develop, and operate the backend systems that power Arbiter's agent-driven care orchestration workflows, including service orchestration, inference pipelines, and automation primitives.

Requirements

  • 8 + years of hands-on experience building and operating production backend systems, recent experience with AI-powered services and automation workflows, in high-availability environments.
  • Computer Science or Engineering degree, or equivalent practical experience.
  • Proven experience designing and operating complex backend systems in production.
  • Hands-on experience with async or event-driven architectures.
  • Experience designing and operating high-scale APIs (REST and/or gRPC), including versioning and backward compatibility.
  • Experience with cloud infrastructure (AWS, GCP, or Azure) and production deployments.
  • Strong communication skills and ability to work effectively across functions.

Nice to have

  • Experience integrating LLM APIs and understanding prompt engineering and evaluation methodologies.
  • Proficiency with AI-assisted development tools (e.g., Cursor, Claude Code, GitHub Copilot).
  • Track record of delivering complex systems end-to-end with minimal oversight.
  • Startup or early-stage experience operating in fast-moving, high-ambiguity environments.

Compensation

  • Designed to rival top FAANG compensation, including meaningful equity.
  • The annual base salary range for this position is $190,000-$250,000.
  • Actual compensation offered to the successful candidate may vary from the posted hiring range based on work experience, skill level, and other factors.

Benefits

  • We are looking for expert engineers and leads to join our team and help us push the frontier of what's possible with agentic workflows in healthcare.
  • Robust coverage for you and your family.
  • Support for conferences, courses, and certifications to fuel your continuous learning.
Apply directly at Arbiter AI →Create a free account for alerts like thisView Arbiter AI immigration profile

This listing is sourced directly from Arbiter AI's careers page and normalized into a canonical job model.