Ellipsis Health
Senior Backend Engineer, Infrastructure
San Francisco - Hybrid · Senior
Sponsorship not specified$175k-$250kDetected 82 days ago
PythonFastAPIPostgreSQLRedisAWSGCPAzureKubernetesTerraformgRPCKafkaWebSocketsMachine LearningData EngineeringLLMsAI OrchestrationComplianceVoIPHIPAACommunication
About the role
- The team is headquartered in Silicon Valley and is funded and supported by preeminent venture capital groups and healthcare institutions.
- The typical salary range for this role is $175,000 to $250,000 USD.
- Please know that there is no set policy on rejecting candidates because of certain background check results, and that we look at a candidate as a whole before making any decisions.
Responsibilities
- Expand and maintain our real-time voice pipeline: design, implement, and
- maintain Python micro-services for conversational AI orchestration-audio
- adapters that allow hot-swapping components without downtime. Build API
- Deliver ultra-low latency (<500 ms round-trip): profile async pipelines (asyncio,
- FastAPI, gRPC), optimize buffering, concurrency, and back-pressure handling.
- LLM, and memory services; wire up WebRTC, SIP, or phone endpoints; build
- Harden for production: implement graceful retries, idempotent message
- Collaborate cross-functionally with ML, product, data engineering, and
- client-SDK teams to deliver features such as voice cloning, multimodal hand-offs,
- design, implement, and
Requirements
- Proven experience with real-time streaming systems-WebRTC, WebSockets,
- or gRPC streaming-and proficiency with asyncio, FastAPI, or similar async
- Familiarity with voice-agent frameworks,
- Familiarity with GPU inference and streaming pipelines.
- 4+ years building production back-ends in modern Python.
- frameworks.
- Deep understanding of concurrency, buffering, audio codecs (Opus, PCM), and
- distributed tracing.
- Solid understanding of AWS/GCP/Azure, including container orchestration
- (Kubernetes/EKS/GKE), message queues (Kafka/SQS/Pub/Sub), and IaC
- (Terraform).
- Solid grasp of relational (PostgreSQL) and in-memory (Redis) data stores
- to model and persist conversational state.
- Excellent communication skills and a bias for measured, observable, and
Compensation
- The typical salary range for this role is $175,000 to $250,000 USD.
Benefits
- We offer competitive salary and benefits, including 401k matching up to a certain
- percentage of your salary, health, vision, and dental insurance, and very flexible paid
- As a health technology company, we reserve the right to run a background check on
- Ellipsis Health is developing cutting-edge AI/ML products to address healthcare staffing issues and administrative burdens.
- The platform employs conversational AI and patented vocal biomarker technology to deliver improved healthcare experiences for clients and patients.
- If you have a disability or otherwise require any assistance whatsoever in the
Apply directly at Ellipsis Health →Create a free account for alerts like thisView Ellipsis Health immigration profile
This listing is sourced directly from Ellipsis Health's careers page and normalized into a canonical job model.