Liquid AI
Member of Technical Staff - Distributed Training Engineer
San Francisco · Staff+
Sponsorship not specifiedDetected 358 days ago
Distributed SystemsSite Reliability EngineeringMachine LearningPyTorchData Engineering
About the role
- Spun out of MIT CSAIL, we build general-purpose AI systems that run efficiently across deployment targets, from data center accelerators to on-device hardware, ensuring low latency, minimal memory usage, privacy, and reliability. We partner with enterprises across consumer electronics, automotive, life sciences, and financial services. We are scaling
- rapidly and need exceptional people to help us get there.
Responsibilities
- Our systems support model architectures that are still evolving.
- Build systems from scratch for novel architectures.
- As we scale, we need to design, implement, and optimize the infrastructure that enables large-scale training.
- Greenfield challenges: Build systems from scratch for novel architectures.
Requirements
- Experience diagnosing performance bottlenecks and failure modes (profiling, NCCL/collectives issues, hangs, OOMs, stragglers)
- Experience optimizing data pipelines for ML workloads
Nice to have
- MoE (Mixture of Experts) training experience
- Large-scale distributed training (100+ GPUs)
- Open-source contributions to training infrastructure projects
- Training throughput has increased
- Overall training efficiency/cost has improved
- Training stability has improved (fewer failures, faster recovery)
- Data loading bottlenecks are eliminated for multimodal workloads
- This is a high-ownership training systems role focused on runtime/performance/reliability (not a general platform/SRE role).
Skills
- Build scalable distributed training infrastructure for GPU clusters
- Implement and tune parallelism/sharding strategies for evolving architectures
Compensation
- Competitive base salary with equity in a unicorn-stage company
- Health: We pay 100% of medical, dental, and vision premiums for employees and dependents
- Financial: 401(k) matching up to 4% of base pay
Benefits
- Compensation: Competitive base salary with equity in a unicorn-stage company
- Health: We pay 100% of medical, dental, and vision premiums for employees and dependents
- Time Off: Unlimited PTO plus company-wide Refill Days throughout the year
Apply directly at Liquid AI →Create a free account for alerts like thisView Liquid AI immigration profile
This listing is sourced directly from Liquid AI's careers page and normalized into a canonical job model.