Together AI

Research Engineer, Frontier Speculative Decoding

San Francisco, New York City · Full-time

Sponsorship not specified$190k-$270kDetected 75 days ago

PythonAlgorithmsKubernetesMachine LearningLLMsResearch

About the role

Your role will be a critical bridge between cutting-edge research and real-world applications, focusing on making translating our internal model training research to production-ready deployment for our customers.
This involves a deep commitment to data-centric development, meticulous hyperparameter tuning, and rigorous checkpoint evaluation before models ever hit production.
This role will involve understanding customer specific needs and fine-tuning models on our internal data recipe and their proprietary data.

Design and iterate on novel speculator algorithms, combining architectural innovations with carefully curated data to push the frontier of accuracy-efficiency tradeoffs.
Collaborate with a team of experts dedicated to solving real-world, high-performance challenges.
Demonstrated ability to perform effective hyperparameter searches and understand the trade-offs involved in tuning models for specific tasks.

You are comfortable navigating complex code and contributing to its improvement.
Experience with Python and PyTorch.
Familiarity with SLURM and/or Kubernetes clusters and experience submitting and managing jobs in a high-performance computing environment.
Familiarity with modern LLMs and generative models.
Bachelor's, Master's degree, or Ph.D. in Computer Science, Computer Engineering, or a related field, or equivalent practical experience.

The goal is to transform general-purpose models into highly performant, specialized tools that solve real business problems.

We offer competitive compensation, startup equity, health insurance and other competitive benefits.
The US base salary range for this full-time position is: $190,000 - $270,000 + equity + benefits.
Our salary ranges are determined by location, level and role.
Individual compensation will be determined by experience, skills, and job-related knowledge.

Be the critical link between raw data and a production-ready model, seeing your work directly impact our customers' success.
You'll collaborate directly with customers to understand their needs, and work closely with our core inference and Applied ML research teams to integrate your work into the production platform.

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

t opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more

This listing is sourced directly from Together AI's careers page and normalized into a canonical job model.