Sambanovasystems

Sambanovasystems

Senior AI Systems Performance Engineer

San Jose, California, United States · Senior · Full-time

Sponsorship not specifiedDetected 14 days ago
PythonC++Node.jsFull-Stack DevelopmentData StructuresAlgorithmsMachine LearningDeep LearningTensorFlowPyTorchNLPLLMsStatisticsElectrical Engineering

About the role

  • You'll work hands-on with some of the most advanced models in the world - such as DeepSeek R1, GPT OSS, and other frontier architectures - to push the limits of throughput, latency, and efficiency.

Responsibilities

  • Bring up and optimize cutting-edge foundation models (e.g., DeepSeek, Llama, Qwen, and others) on the SambaNova platform through the SambaNova software stack.
  • Develop robust, scalable, and efficient end-to-end inference solutions aligned with customer needs.

Requirements

  • Bachelor's or higher degree in computer science, electrical engineering, or a related field (e.g., applied mathematics, physics, or statistics).
  • 3+ years of experience in one or more of the following areas:
  • Proficiency in Python or C++, with strong foundations in algorithms, data structures, and numerical computing.
  • Experience with at least one major ML framework - PyTorch, TensorFlow, or JAX.

Nice to have

  • Hands-on experience with LLM or multimodal model training and inference.
  • Background in large-scale distributed training, continuous batching, and high-throughput inference systems.
  • Familiarity with quantization, graph optimization, kernel fusion, and model partitioning.
  • Experience with frameworks such as DeepSpeed, Megatron, vLLM, or TensorRT.
  • Strong GPU programming skills (CUDA, Triton, or OpenCL)
  • experience with cuDNN, cuBLAS, or similar libraries is a plus.
  • Knowledge of memory hierarchy optimization, caching, and scheduling for large-scale model execution.
  • Publication record or open-source contributions in ML systems or performance optimization is a plus.

Skills

  • The era of pervasive AI has arrived.
  • SambaNova Suite™ is the first full-stack, generative AI platform, from chip to model, optimized for enterprise and government organizations.

Compensation

  • SambaNova offers a competitive total rewards package, including the base salary, plus equity and benefits.

Benefits

  • SambaNova offers a competitive total rewards package, including the base salary, plus equity and benefits.
  • We cover 95% premium coverage for employee medical insurance, and 77% premium coverage for dependents and offer a Health Savings Account (HSA) with employer contribution.
  • We also offer Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life, and AD&D insurance plans in addition to Flexible Spending Account (FSA) options like Health Care, Limited Purpose, and Dependent Care.
  • Collaborate with machine learning, compiler, runtime, and hardware teams to deliver co-designed, high-performance AI applications.
  • In this role, you'll bridge the gap between deep learning and systems performance, collaborating across compiler, runtime, and hardware layers to deliver world-record performance for large-scale AI inference.

Company info

  • We are seeking a talented and driven ML performance engineer to optimize and scale state-of-the-art foundation models on SambaNova's reconfigurable dataflow platform.
Apply directly at Sambanovasystems →Create a free account for alerts like thisView Sambanovasystems immigration profile

This listing is sourced directly from Sambanovasystems's careers page and normalized into a canonical job model.