Together AI

Together AI

Backend Software Engineer — Data Platform & AI Data Products

San Francisco · Full-time

Sponsorship not specified$120k-$170kDetected 74 days ago
PythonJavaGoRustBackend DevelopmentAlgorithmsSQLPostgreSQLAPI DevelopmentRESTKafkaMachine LearningSparkAirflowLLMsRAGIncident ResponseResearchMentoring

About the role

  • You'll join the Data Platform team, responsible for building the backend services and "data products" that power how data moves through the company.
  • We create the core platform primitives - high-quality event streams, reliable access layers, and developer-friendly APIs/tools - so teams across the org can self-serve what they need and ship faster.
  • You'll also work on LLM-adjacent services such as prompt categorization/taxonomy, enrichment, and metadata systems that turn raw telemetry into trusted, usable products - with mentorship and support from experienced engineers.

Responsibilities

  • Create/consume streams and subscriptions
  • Manage dataset/catalog metadata, lineage, versioning, and retention
  • Work on prompt categorization and enrichment services: taxonomy design, labeling workflows, classifier/rules integration, evaluation, drift/quality monitoring, and safe rollouts.
  • Learn to own reliability: SLOs, alerting, performance/cost tuning, incident response, and postmortems.
  • Partner cross-functionally with ML/LLM, infra, security, and product teams to define crisp contracts and deliver durable platform primitives.
  • taxonomy design, labeling workflows, classifier/rules integration, evaluation, drift/quality monitoring, and safe rollouts.
  • design docs, implementation, testing, deployment, and iteration based on real usage.
  • clean, maintainable code, thoughtful abstractions, and a desire to build systems that are easy to evolve.
  • Passion for good quality code, highly readable, SOLID principles, design patterns, Domain Driven Design.

Nice to have

  • Any exposure to self-serve platforms, developer tooling, or multi-tenant services.
  • Coursework or projects involving LLM/AI products: prompt/response telemetry, eval datasets, embeddings/RAG metadata, model/tool traces, privacy-safe logging.
  • Awareness of security and governance basics: least-privilege access, auditability, data retention, PII handling.
  • About Together AI
  • Together AI is a research-driven artificial intelligence company.
  • We have contributed to leading open-source research, models, and datasets to advance the frontier of AI, and our team has been behind technological advancement such as FlashAttention, Hyena, FlexGen, and RedPajama.
  • Individual compensation will be determined by experience, skills, and job-related knowledge.

Skills

  • Streaming/eventing (Kafka/PubSub/Kinesis, etc.)
  • Workflow/compute (Airflow/Spark/Flink/Trino, etc.)
  • OLTP/OLAP stores and data lakes (Postgres + warehouse/lake tech)

Compensation

  • We offer competitive compensation, startup equity, health insurance and other competitive benefits.
  • The US base salary range for this full-time position is: $120,000 - $170,000 + equity + benefits.
  • Our salary ranges are determined by location, level and role.
  • Individual compensation will be determined by experience, skills, and job-related knowledge.

Company info

  • Define/publish events and schemas
  • Establish access models (authz, row/field-level controls where applicable)
  • Contribute to end-to-end data products: ingestion → validation/quality → enrichment → serving (APIs/streams) → observability → adoption.
  • Requirements
  • 0-4 years building production or project-based backend systems (internships, coursework, and personal projects count).
  • Solid fundamentals in at least one backend language (e.g., Go, Python, Java, Rust) and some exposure to API design (REST).
  • Eagerness to own work end-to-end: design docs, implementation, testing, deployment, and iteration based on real usage.
  • Strong engineering fundamentals: clean, maintainable code, thoughtful abstractions, and a desire to build systems that are easy to evolve.
  • Basic data modeling and SQL skills, and some familiarity with at least one of:

Equal opportunity

  • Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Visa & Work Authorization

  • t opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more
Apply directly at Together AI →Create a free account for alerts like thisView Together AI immigration profile

This listing is sourced directly from Together AI's careers page and normalized into a canonical job model.