Together AI

Together AI

Senior Platform Engineer, Voice AI

San Francisco · Senior · Full-time

Sponsorship not specified$200k-$260kDetected 76 days ago
TypeScriptPythonRustReactNext.jsDistributed SystemsFull-Stack DevelopmentAlgorithmsKubernetesPlatform EngineeringAPI DevelopmentWebSocketsMachine LearningAgentic AIAccountingLoad BalancingVoIPResearchCommunication

About the role

  • Our Voice AI platform powers production-grade, real-time voice agents and applications - serving speech-to-text and text-to-speech models with best-in-class latency and reliability.
  • This is a foundational hire on a small, high-impact team.
  • You'll define how developers interact with Together's voice platform as we grow from early customers to the default infrastructure for voice AI.

Responsibilities

  • Build and harden real-time WebSocket and HTTP streaming APIs for STT and TTS - including connection lifecycle management, backpressure, error handling, and reconnection, at the reliability bar needed for production voice agents.
  • Design and ship autoscaling for voice model endpoints that handles bursty, real-time traffic patterns - accounting for concurrent connection limits, streaming state, and hard latency ceilings.
  • Implement voice-specific API features: word-level alignment, speaker diarization in realtime, audio format flexibility (g711/mulaw for telephony, PCM, WebRTC formats), pronunciation controls, and multi-context WebSocket support.
  • Own multi-model normalization across our model partners (Cartesia, Deepgram, Rime, and others), ensuring consistent API behavior regardless of the underlying provider.
  • Collaborate with the ML engineering side of the team on the interface between the API layer and the model serving stack, ensuring latency and reliability requirements are met end-to-end.
  • Contribute to developer experience - API design, documentation, integration cookbooks, playground and showcasing how best-in-class voice agents are built.
  • Own the real-time API layer (WebSocket + HTTP streaming) that powers Together's voice platform.
  • Design autoscaling and orchestration for voice workloads running on tens of thousands of GPUs.
  • Strong product sense - you care about API ergonomics and think about what developers building voice apps actually need.

Requirements

  • 5+ years of experience building large-scale, real-time distributed systems and API services.
  • Comfort working on a small, early-stage team where you'll wear multiple hats and move fast.
  • Bachelor's or Master's degree in Computer Science, Computer Engineering, or related field, or equivalent practical experience.

Nice to have

  • experience with Rust is a plus.
  • Experience with audio or media protocols (WebRTC, g711, PCM encoding) is a strong plus.
  • Familiarity with ML model serving infrastructure and how inference engines work is a plus - you'll interface with the serving layer regularly.
  • Expert-level programming in TypeScript and Python

Compensation

  • We offer competitive compensation, startup equity, health insurance and other competitive benefits.
  • The US base salary range for this full-time position is: $200,000 - $260,000 + equity + benefits.
  • Our salary ranges are determined by location, level and role.
  • Individual compensation will be determined by experience, skills, and job-related knowledge.

Benefits

  • Experience with Kubernetes - including custom autoscalers, resource management, and health checking for stateful services.
  • Build the developer experience - APIs, observability, and tooling - for a fast-growing product area.

Company info

  • Build voice-specific observability - latency breakdowns, audio quality signals, and dashboards that help both the team and customers debug issues.
  • We're looking for a Senior Platform Engineer to own the API and infrastructure layer for voice workloads.
  • Work with production voice customers (contact centers, AI agents, communication platforms) to ship what they actually need.

Equal opportunity

  • Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Visa & Work Authorization

  • t opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more
Apply directly at Together AI →Create a free account for alerts like thisView Together AI immigration profile

This listing is sourced directly from Together AI's careers page and normalized into a canonical job model.