Together AI
Research Intern, Inference (Fall 2026)
San Francisco · Intern · Internship
Sponsorship not specified$12k-$16kDetected 29 days ago
PythonAlgorithmsMachine LearningDeep LearningPyTorchNLPSystems EngineeringElectrical EngineeringResearch
About the role
- Our work operates at the critical intersection of cutting-edge model architectures, high-performance systems engineering, and deep hardware optimization.
- We focus on co-designing software, algorithms, and models to significantly lower the cost and latency of modern AI systems.
- As a research intern, you will dive into the complexities of distributed inference, compiler-aware optimization, and novel inference-time computation strategies (such as speculative decoding and phase-aware execution).
Responsibilities
- Design and conduct rigorous experiments to validate hypotheses
- Document findings in scientific publications and blog posts
Requirements
- Currently pursuing a final year of Bachelor's, Master's, or Ph.D. degree in Computer Science, Electrical Engineering, or a related field
- Familiarity with Transformer architectures and recent developments in foundation models
Nice to have
- Experience with CUDA programming (for kernel development)
- Understanding of model optimization techniques and hardware acceleration approaches
- Internship Program Details
- Our internship dates are September 14th to December 18th.
- About Together AI
- Together AI is a research-driven artificial intelligence company.
- The estimated US hourly rate for this role is $58-63/hr.
- Individual compensation will be determined by experience, skills, and job-related knowledge.
Compensation
- We offer competitive compensation, housing stipends, and other competitive benefits.
- The estimated US hourly rate for this role is $58-63/hr.
- Our hourly rates are determined by location, level and role.
- Individual compensation will be determined by experience, skills, and job-related knowledge.
Benefits
- Strong knowledge of Machine Learning and Deep Learning fundamentals
- Experience with deep learning frameworks (PyTorch, JAX, etc.)
- Prior research experience in foundation models, efficient machine learning, or ML systems.
- Publications at leading conferences in machine learning or systems (i.e., MLSys, ICLR ).
Equal opportunity
- Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
Visa & Work Authorization
- t opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more
Apply directly at Together AI →Create a free account for alerts like thisView Together AI immigration profile
This listing is sourced directly from Together AI's careers page and normalized into a canonical job model.