Together AI

Together AI

Senior Software Engineer - Together Cloud Platform

San Francisco · Senior · Full-time

Sponsorship not specified$160k-$230kDetected 12 days ago
GoDistributed SystemsBackend DevelopmentAlgorithmsCode ReviewPostgreSQLAWSGCPAzureCloud PlatformsKubernetesCI/CDKafkaMachine LearningAirflowLLMsResearchCommunication

About the role

  • This platform serves both our internal StaaS products (inference, fine-tuning) and our external cloud customers, spanning dozens of data centers across the world.

Responsibilities

  • Identify, design, and develop foundational backend services that power Together's cloud platform
  • Partner with product teams to understand functional requirements and deliver solutions that meet business needs
  • Conduct design and code reviews, create developer documentation, and develop testing strategies for robustness and fault tolerance
  • 5+ years of demonstrated experience in building large scale, fault tolerant, distributed systems and API microservices
  • Excellent communication skills - able to write clear design docs and work effectively with both technical and non-technical team members
  • Experience developing against and managing a relational database, such as PostgreSQL

Requirements

  • Experience designing, analyzing and improving efficiency, scalability, and stability of various system resources
  • Demonstrated experience with building and operating high-performance and/or globally distributed microservice architectures across one or more cloud providers (AWS, Azure, GCP)
  • Proficiency in version control practices and integrating IaC with CI/CD pipelines.
  • Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience

Nice to have

  • Expert-level programmer in one or more of programming language (Golang preferred)
  • Experience with Kubernetes and containers preferred

Skills

  • Work on a distributed GPU scheduling system for the on-demand clusters product, Instant Clusters.

Compensation

  • We offer competitive compensation, startup equity, health insurance, and other benefits, as well as flexibility in terms of remote work.
  • The US base salary range for this full-time position is: $160,000 - $230,000 + equity + benefits.
  • Our salary ranges are determined by location, level and role.
  • Individual compensation will be determined by experience, skills, and job-related knowledge.

Equal opportunity

  • Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Visa & Work Authorization

  • t opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more

This listing is sourced directly from Together AI's careers page and normalized into a canonical job model.