Baseten

Software Engineer- GPU Fabric Observability

San Francisco

Sponsorship not specifiedDetected 15 days ago

Distributed SystemsKubernetesMachine LearningSparkResearch

About the role

Software-aware RDMA diagnosis - Tie network behavior to RDMA operations, GPUDirect paths, KV cache transfers, prefill/decode disaggregation, and request latency.
This is a hard distributed systems problem, not a dashboarding problem.
The system will collect high-volume signals from switches, hosts, active probes, and inference services; reduce and correlate them in real time; understand topology and service ownership; and produce actionable diagnosis while an incident is still unfolding.

Own Baseten's GPU fabric observability and root-cause analysis architecture.
Build telemetry pipelines across switches, NICs, hosts, GPUs, Kubernetes, and inference services.
We're growing quickly and recently raised our $1.5B Series F https://www.baseten.co/blog/announcing-our-series-f/, led by Altimeter Capital, Conviction Partners, and Spark Capital.
Join us and help build the platform engineers turn to to ship AI products.
Real-time telemetry engine - Build the ingestion, reduction, storage, and query path for high-cardinality fabric, host, GPU, and workload telemetry.
Service-aware fabric diagnosis - Build collectors, probes, and topology-aware correlation to detect latency, drops, stalls, congestion, bad paths, and degradation.
Baseten is building its own GPU infrastructure for large-scale inference.

Competitive compensation, including meaningful equity.
100% coverage of medical, dental, and vision insurance for employee and dependents
Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
Paid parental leave
Fertility and family-building stipend through Carrot
Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.
Create clear operator workflows for triage, remediation, and post-incident learning.
By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production.

We are hiring a Lead Software Engineer to build a first-class observability and root-cause analysis system for GPU fabrics.
At Baseten, we are committed to fostering a diverse and inclusive workplace.

This listing is sourced directly from Baseten's careers page and normalized into a canonical job model.