SambaNova
Senior AI Systems Performance Engineer
San Jose, California, United States · Senior · Full-time
Sponsorship not specifiedDetected 14 days ago
PythonC++Node.jsFull-Stack DevelopmentData StructuresAlgorithmsMachine LearningDeep LearningTensorFlowPyTorchNLPLLMsStatisticsElectrical Engineering
About the role
- You'll work hands-on with some of the most advanced models in the world - such as DeepSeek R1, GPT OSS, and other frontier architectures - to push the limits of throughput, latency, and efficiency.
Responsibilities
- Bring up and optimize cutting-edge foundation models (e.g., DeepSeek, Llama, Qwen, and others) on the SambaNova platform through the SambaNova software stack.
- Develop robust, scalable, and efficient end-to-end inference solutions aligned with customer needs.
Requirements
- Bachelor's or higher degree in computer science, electrical engineering, or a related field (e.g., applied mathematics, physics, or statistics).
- 3+ years of experience in one or more of the following areas:
- Proficiency in Python or C++, with strong foundations in algorithms, data structures, and numerical computing.
- Experience with at least one major ML framework - PyTorch, TensorFlow, or JAX.
Nice to have
- Hands-on experience with LLM or multimodal model training and inference.
- Background in large-scale distributed training, continuous batching, and high-throughput inference systems.
- Familiarity with quantization, graph optimization, kernel fusion, and model partitioning.
- Experience with frameworks such as DeepSpeed, Megatron, vLLM, or TensorRT.
- Strong GPU programming skills (CUDA, Triton, or OpenCL)
- experience with cuDNN, cuBLAS, or similar libraries is a plus.
- Knowledge of memory hierarchy optimization, caching, and scheduling for large-scale model execution.
- Publication record or open-source contributions in ML systems or performance optimization is a plus.
Skills
- The era of pervasive AI has arrived.
- SambaNova Suite™ is the first full-stack, generative AI platform, from chip to model, optimized for enterprise and government organizations.
Compensation
- SambaNova offers a competitive total rewards package, including the base salary, plus equity and benefits.
Benefits
- SambaNova offers a competitive total rewards package, including the base salary, plus equity and benefits.
- We cover 95% premium coverage for employee medical insurance, and 77% premium coverage for dependents and offer a Health Savings Account (HSA) with employer contribution.
- We also offer Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life, and AD&D insurance plans in addition to Flexible Spending Account (FSA) options like Health Care, Limited Purpose, and Dependent Care.
- Collaborate with machine learning, compiler, runtime, and hardware teams to deliver co-designed, high-performance AI applications.
- In this role, you'll bridge the gap between deep learning and systems performance, collaborating across compiler, runtime, and hardware layers to deliver world-record performance for large-scale AI inference.
Company info
- We are seeking a talented and driven ML performance engineer to optimize and scale state-of-the-art foundation models on SambaNova's reconfigurable dataflow platform.
Apply directly at SambaNova →Create a free account for alerts like thisView SambaNova immigration profile
This listing is sourced directly from SambaNova's careers page and normalized into a canonical job model.