Together AI

Together AI

Research Engineer, Post-Training Inference

San Francisco · Full-time

Sponsorship not specified$200k-$290kDetected 3 days ago
PythonGoAlgorithmsKubernetesMachine LearningNLPLLMsResearch

About the role

  • The Model Shaping team at Together AI works on products and research focused on tailoring open foundation models to downstream applications.

Responsibilities

  • Design and build Together's systems for customizing open-source models
  • Build integrations between the Model Shaping and Inference platforms to ensure a seamless path from post-training to serving production workloads
  • Developing CUDA/Triton/CuTE DSL kernels for inference

Requirements

  • Have hands-on experience with modern inference engines, such as SGLang, vLLM, and TensorRT-LLM

Compensation

  • We offer competitive compensation, startup equity, health insurance, and other benefits.
  • The US base salary range for this full-time position is $200,000 - $290,000.
  • Our salary ranges are determined by location, level and role.
  • Individual compensation will be determined by experience, skills, and job-related knowledge.

Benefits

  • Have 2+ years of experience building and deploying machine learning-based services in a production environment
  • Stay up to date with the latest advances and trends in the machine learning community

Company info

  • Make sure the service is stable and robust, participating in an on-call rotation and ensuring 24/7 availability of our platform
  • Experience in any of the following will make you stand out

Equal opportunity

  • Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Visa & Work Authorization

  • t opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more

This listing is sourced directly from Together AI's careers page and normalized into a canonical job model.