Cohere

Cohere

Engineering Manager, GPU Infrastructure

United States · Full-time

Sponsorship not specifiedDetected 15 hours ago
Distributed SystemsCloud PlatformsKubernetesTerraformPrometheusGrafanaMachine LearningTensorFlowPyTorchResearchLeadershipCommunicationCollaborationProblem SolvingMentoringArgo CD

About the role

  • Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.
  • We're not just managing hardware - we're enabling the research and development that defines what's possible with large language models.

Responsibilities

  • We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities.

Requirements

  • Experience with cost optimization and capacity planning for GPU infrastructure

Skills

  • Experience managing engineering teams with a focus on technical mentorship and growth
  • Strong communication skills to translate complex technical concepts for diverse audiences
  • Ability to make data-informed decisions under pressure
  • Experience working in remote, distributed teams
  • Commitment to fostering an inclusive and collaborative team culture
  • Cohere is the leading security-first enterprise AI company.
  • GPU/TPU clusters, distributed training frameworks (JAX, PyTorch, TensorFlow), and high-performance computing environments

Compensation

  • Annual enrichment

Benefits

  • 6 weeks of paid vacation (30 working days!)
  • A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
  • Full health and dental benefits, including a separate budget for mental health.
  • RRSP matching, 401K, Pension Scheme.
  • 100% Parental Leave top-up for up to 6 months, for either parent.
  • Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.
  • Education & learning stipend for conferences, courses, and coaching.
  • For those not near an office: a co-working benefit so you can work alongside others in your city.
  • Everyone receives a $500 home office stipend to set up your workspace properly.

This listing is sourced directly from Cohere's careers page and normalized into a canonical job model.