Ellipsis Health

Ellipsis Health

Senior Backend Engineer, Infrastructure

San Francisco - Hybrid · Senior

Sponsorship not specified$175k-$250kDetected 82 days ago
PythonFastAPIPostgreSQLRedisAWSGCPAzureKubernetesTerraformgRPCKafkaWebSocketsMachine LearningData EngineeringLLMsAI OrchestrationComplianceVoIPHIPAACommunication

About the role

  • The team is headquartered in Silicon Valley and is funded and supported by preeminent venture capital groups and healthcare institutions.
  • The typical salary range for this role is $175,000 to $250,000 USD.
  • Please know that there is no set policy on rejecting candidates because of certain background check results, and that we look at a candidate as a whole before making any decisions.

Responsibilities

  • Expand and maintain our real-time voice pipeline: design, implement, and
  • maintain Python micro-services for conversational AI orchestration-audio
  • adapters that allow hot-swapping components without downtime. Build API
  • Deliver ultra-low latency (<500 ms round-trip): profile async pipelines (asyncio,
  • FastAPI, gRPC), optimize buffering, concurrency, and back-pressure handling.
  • LLM, and memory services; wire up WebRTC, SIP, or phone endpoints; build
  • Harden for production: implement graceful retries, idempotent message
  • Collaborate cross-functionally with ML, product, data engineering, and
  • client-SDK teams to deliver features such as voice cloning, multimodal hand-offs,
  • design, implement, and

Requirements

  • Proven experience with real-time streaming systems-WebRTC, WebSockets,
  • or gRPC streaming-and proficiency with asyncio, FastAPI, or similar async
  • Familiarity with voice-agent frameworks,
  • Familiarity with GPU inference and streaming pipelines.
  • 4+ years building production back-ends in modern Python.
  • frameworks.
  • Deep understanding of concurrency, buffering, audio codecs (Opus, PCM), and
  • distributed tracing.
  • Solid understanding of AWS/GCP/Azure, including container orchestration
  • (Kubernetes/EKS/GKE), message queues (Kafka/SQS/Pub/Sub), and IaC
  • (Terraform).
  • Solid grasp of relational (PostgreSQL) and in-memory (Redis) data stores
  • to model and persist conversational state.
  • Excellent communication skills and a bias for measured, observable, and

Compensation

  • The typical salary range for this role is $175,000 to $250,000 USD.

Benefits

  • We offer competitive salary and benefits, including 401k matching up to a certain
  • percentage of your salary, health, vision, and dental insurance, and very flexible paid
  • As a health technology company, we reserve the right to run a background check on
  • Ellipsis Health is developing cutting-edge AI/ML products to address healthcare staffing issues and administrative burdens.
  • The platform employs conversational AI and patented vocal biomarker technology to deliver improved healthcare experiences for clients and patients.
  • If you have a disability or otherwise require any assistance whatsoever in the

This listing is sourced directly from Ellipsis Health's careers page and normalized into a canonical job model.