Together AI

Together AI

Staff Platform Engineer, Voice AI

San Francisco · Staff+ · Full-time

Sponsorship not specified$220k-$280kDetected 63 days ago
TypeScriptPythonReactNext.jsDistributed SystemsFull-Stack DevelopmentAlgorithmsKubernetesPlatform EngineeringAPI DevelopmentWebSocketsMachine LearningAgentic AILoad BalancingVoIPResearchLeadershipCommunication

About the role

  • Together AI is defining the infrastructure layer for the next generation of voice applications.
  • This isn't a role about maintaining what exists.
  • You'll bring the judgment to get this right the first time, at scale.

Responsibilities

  • Own the architecture and reliability of Together's real-time API layer - set the technical direction for WebSocket and HTTP streaming APIs powering STT and TTS at scale
  • Lead autoscaling architecture for latency-sensitive voice workloads - design and ship orchestration systems that handle bursty, real-time traffic across tens of thousands of GPUs
  • Define the voice API feature surface - make the architectural calls on word-level alignment, real-time speaker diarization, audio format support (g711/mulaw, PCM, WebRTC), pronunciation controls, and multi-context WebSocket - with a clear view of what unlocks the next category of developer use cases.
  • Build the observability platform for voice infrastructure - design the latency breakdown pipelines, audio quality signal collection, and customer-facing dashboards that give both the team and developers the instrumentation they need to operate at production quality
  • Own the multi-provider abstraction layer - architect the normalization layer across model partners (Cartesia, Deepgram, Rime, and others) that delivers consistent, provider-agnostic API behavior
  • your design should absorb upstream variability without exposing it to developers.
  • Drive the interface between API and ML serving - partner closely with ML engineering leadership to define the contract between the API layer and the model serving stack
  • Raise the bar for developer experience across the platform - lead API design reviews, shape documentation strategy, define integration patterns and cookbooks
  • Architect for the product surface that doesn't exist yet - build systems with the foresight that they become the foundation for multiple new voice products

Requirements

  • 8+ years of experience building large-scale, real-time distributed systems - with clear ownership of systems that carried production traffic at meaningful scale
  • you can speak to the architectural decisions you made and defend the tradeoffs.
  • Expert-level TypeScript and Python, with strong proficiency in systems-level thinking
  • Sharp product intuition for developer platforms - you have genuine opinions about API ergonomics, you think from the developer's perspective first, and you've shipped tooling that developers actually praised.
  • Proven ability to operate with autonomy on high-ambiguity, high-stakes problems - you define the right problem before optimizing the solution, and you've done it on teams where the roadmap wasn't handed to you.
  • Bachelor's or Master's in Computer Science, Computer Engineering, or related field - or equivalent depth demonstrated through your work.

Nice to have

  • Experience with audio and media protocols (WebRTC, g711, PCM encoding) is strongly preferred at this level - the domain specificity matters.
  • Full-stack experience (React, Next.js) for developer-facing tooling contributions is a plus.

Compensation

  • We offer competitive compensation, startup equity, health insurance and other competitive benefits.
  • The US base salary range for this full-time position is: $220,000 - $280,000 + equity + benefits.
  • Our salary ranges are determined by location, level and role.
  • Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal opportunity

  • Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Visa & Work Authorization

  • t opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more
Apply directly at Together AI →Create a free account for alerts like thisView Together AI immigration profile

This listing is sourced directly from Together AI's careers page and normalized into a canonical job model.