SambaNova

SambaNova

AI Systems Performance Engineer - New Graduate

San Jose, California, United States · Internship

Sponsorship not specified$135k-$165kDetected 9 days ago
PythonC++Node.jsDistributed SystemsFull-Stack DevelopmentData StructuresAlgorithmsMachine LearningDeep LearningTensorFlowPyTorchNLPLLMsStatisticsElectrical EngineeringResearchProblem Solving

About the role

  • You'll work hands-on with advanced AI models - such as DeepSeek, GLM, Kimi, GPT OSS, Llama, Qwen, and other frontier architectures - and learn how modern AI systems achieve high throughput, low latency, and efficient large-scale inference.
  • In this role, you'll work at the intersection of machine learning and computer systems, collaborating with engineers across model, compiler, runtime, and hardware teams.

Responsibilities

  • Optimize AI workloads for throughput, latency, memory efficiency, and scalability.
  • Develop tools, benchmarks, and performance analysis methodologies for large-scale AI inference.
  • This is an ideal opportunity for a new graduate who is passionate about understanding how AI models execute on real hardware and wants to help build the next generation of high-performance AI systems.

Nice to have

  • Hands-on experience with LLMs, multimodal models, or transformer architectures.
  • Familiarity with model inference, KV cache, batching, quantization, or distributed execution.
  • Experience with GPU or accelerator programming using CUDA, Triton, OpenCL, or similar technologies.
  • Familiarity with frameworks such as vLLM, DeepSpeed, Megatron, or TensorRT.
  • Understanding of memory hierarchy, caching, parallelism, or scheduling.
  • Experience profiling and optimizing the performance of software or ML workloads.
  • Research publications, open-source contributions, programming competitions, or technically challenging personal projects are a plus.
  • We value strong technical fundamentals, curiosity, and the ability to learn quickly.

Skills

  • The era of pervasive AI has arrived.
  • SambaNova Suite™ is the first full-stack, generative AI platform, from chip to model, optimized for enterprise and government organizations.

Compensation

  • Base Pay Range
  • $135,000 - $165,000 USD
  • SambaNova offers a competitive total rewards package, including the base salary, plus equity and benefits.

Benefits

  • SambaNova offers a competitive total rewards package, including the base salary, plus equity and benefits.
  • We cover 95% premium coverage for employee medical insurance, and 77% premium coverage for dependents and offer a Health Savings Account (HSA) with employer contribution.
  • We also offer Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life, and AD&D insurance plans in addition to Flexible Spending Account (FSA) options like Health Care, Limited Purpose, and Dependent Care.
  • Collaborate with machine learning, compiler, runtime, and hardware engineers to develop high-performance AI applications.
  • Benefits Summary for US-Based, Full-Time Employment Positions

Company info

  • We are seeking a talented and highly motivated AI Systems Performance Engineer to bring up and optimize state-of-the-art foundation models on SambaNova's reconfigurable dataflow platform.

Equal opportunity

  • SambaNova Systems is an Equal Opportunity/Affirmative Action Employer.

This listing is sourced directly from SambaNova's careers page and normalized into a canonical job model.