Together AI
Machine Learning, Platform Engineer
San Francisco · Full-time
Sponsorship not specified$160k-$250kDetected 75 days ago
PythonGoC++HaskellDistributed SystemsAlgorithmsCode ReviewKubernetesTerraformPlatform EngineeringMachine LearningPyTorchLLMsResearch
About the role
- Our team focuses on enabling custom models and dedicated inference on Together.
- We often focus on video or audio generation across the stack: CUDA kernels, pytorch optimization, inference engines, container orchestration, queueing theory, etc.
- An ideal candidate will be great at profiling/optimization but know the word kubernetes, or be intimately familiar with multi-cluster scheduling and have some sense of ML bottlenecks.
Responsibilities
- Partner with product teams to understand functional requirements and deliver solutions that meet business needs
- Conduct design and code reviews, create developer documentation, and develop testing strategies for robustness and fault tolerance
- 5+ years of demonstrated experience in building large scale, fault tolerant, distributed systems.
Requirements
- Good taste and ability to thoughtfully discuss how what you've built has failed over time
- Experience designing, analyzing and improving efficiency, scalability, and stability of various system resources
- Proficiency in writing and maintaining Infrastructure as Code (IaC) using tools like Terraform
- Experience with Kubernetes internals or other container orchestration systems
- Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience
Nice to have
- Experience running serverless inference platforms, doing model bring-up on short notice, being on call, or running a cloud provider is a very big plus
- Writing-heavy roles or companies are a plus
Compensation
- We offer competitive compensation, startup equity, health insurance and other competitive benefits.
- The US base salary range for this full-time position is: $160,000 - $250,000 + equity + benefits.
- Our salary ranges are determined by location, level and role.
- Individual compensation will be determined by experience, skills, and job-related knowledge.
Equal opportunity
- Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
Visa & Work Authorization
- t opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more
Apply directly at Together AI →Create a free account for alerts like thisView Together AI immigration profile
This listing is sourced directly from Together AI's careers page and normalized into a canonical job model.