Otterai

Otterai

Machine Learning Engineer

Mountain View, CA

Sponsorship not specified$196k-$221kDetected 25 days ago
Machine LearningPyTorchData EngineeringNLPLLMsAgentic AIResearchCollaboration

About the role

  • Join our core AI team responsible for ML and work alongside industry-veteran scientists and engineers.

Responsibilities

  • Architect, build, and evolve large-scale SID / ASR / NLP / LLM systems that power mission-critical product experiences including summarization, chat, and speech understanding across millions of conversations.
  • Lead the design and implementation of training, fine-tuning, post-training, and inference strategies for large language and speech models using PyTorch and/or JAX, making principled trade-offs across quality, latency, cost, and reliability.
  • Design and improve model architectures, loss functions, decoding strategies, and training techniques for speech and language models, informed by both research and production constraints.
  • Own end-to-end ML system lifecycles, from research prototyping through production deployment, monitoring, iteration, and long-term maintenance.
  • Partner deeply with product, and infrastructure teams to develop and translate cutting-edge research into scalable, production-grade systems that deliver measurable user and business impact.
  • Drive system-level improvements in model performance, robustness, observability, and operational excellence using real-world conversational data at scale.
  • Mentor and elevate other engineers, influencing team standards, reviewing designs, and contributing to a culture of strong technical decision-making and execution.
  • Has deep, hands-on experience building, fine-tuning, and post-training large language models or other foundation models, including an understanding of failure modes and trade-offs.

Nice to have

  • Set technical direction and best practices for ML infrastructure, data pipelines, evaluation frameworks, and deployment workflows in a cloud environment.
  • Identify and resolve complex, ambiguous problems in model behavior, data quality, scaling, and system interactions, often before they surface as user-visible issues.
  • Holds a Bachelor's or Master's degree in Computer Science or a related field with 2+ years of relevant industry experience
  • PhD is preferred.
  • Demonstrates strong command of modern ML research, with the ability to critically evaluate new papers and decide what is production-worthy versus experimental.
  • Has interest in creating innovation and advancing applied research
  • Has extensive experience deploying, monitoring, and operating ML systems in production, including model versioning, rollback strategies, and performance regression detection.
  • Has experience scaling ML systems across training, inference, and serving infrastructure while balancing cost, latency, and reliability constraints.

Compensation

  • Salary Range: $196,000 to $221,000 USD per year.
  • This salary range represents the low and high end of the estimated salary range for this position.
  • The actual base salary offered for the role is dependent based on several factors.
  • Our base salary is just one component of our comprehensive total rewards package.

Company info

  • We're Looking for Someone Who

This listing is sourced directly from Otterai's careers page and normalized into a canonical job model.