Deepgram

Deepgram

Senior Technical Program Manager (Engineering) - AI Tooling & Systems

USA | Remote · Senior

Sponsorship not specifiedDetected 13 days ago
Vector DatabasesAWSGCPAzureCloud PlatformsMachine LearningPyTorchLLMsA/B TestingSystems EngineeringResearchLeadershipCommunication

About the role

  • Deepgram's voice-native foundation models are accessed through cloud APIs or as self-hosted and on-premises software, with unmatched accuracy, low latency, and cost efficiency.
  • There is no organization in the world that understands voice better than Deepgram.
  • At Deepgram, we expect an AI-first mindset-AI use and comfort aren't optional, they're core to how we operate, innovate, and measure performance.

Responsibilities

  • Own end-to-end delivery of AI infrastructure programs-from model training pipelines and experiment tracking to inference serving and production monitoring
  • Drive cost and latency optimization for real-time inference workloads at scale
  • Build lightweight internal tools and processes to accelerate ML iteration cycles (experiment tracking, model versioning, A/B testing infrastructure)
  • Are passionate about building ML systems and infrastructure that powers frontier AI applications

Requirements

  • Hands-on experience with model serving frameworks (vLLM, TensorRT, TorchServe, or similar)
  • Experience with multi-region model serving or edge deployment

This listing is sourced directly from Deepgram's careers page and normalized into a canonical job model.