Modular

Modular

Senior AI Kernel Engineer

USA · Senior

Sponsorship not specified$198k-$286kDetected 176 days ago
C++NLPLLMsCommunicationProblem Solving

About the role

  • You can work in our office in Los Altos, CA or remotely from home.
  • Onboarding for new hires is conducted in-person in our Los Altos, CA office.

Responsibilities

  • Design, implement, and optimize performance-critical kernels for AI inference workloads (e.g., GEMM, attention, communication, fusion).
  • Lead kernel-level optimization efforts across single-GPU, multi-GPU, and heterogeneous hardware environments.
  • Drive adoption of new hardware features (e.g., Tensor Cores, asynchronous execution, advanced memory spaces).
  • Review and mentor other engineers on kernel design, performance tuning, and best practices.
  • Team Building Events.

Requirements

  • 5+ years of experience in performance-critical systems or kernel development (or equivalent depth of expertise).
  • Strong proficiency in C/C++ and low-level programming.
  • Extensive hands-on experience with GPU kernel programming (CUDA, HIP, or equivalent).
  • Proven track record of delivering measurable performance improvements in production systems.
  • Strong problem-solving skills and ability to work independently on complex, ambiguous performance challenges.
  • Experience with PTX, assembly-level tuning, or code generation frameworks (e.g., Triton).
  • Experience optimizing distributed or multi-GPU inference pipelines.
  • Familiarity with custom AI accelerators or domain-specific hardware.
  • Experience collaborating directly with hardware or compiler teams.
  • What you bring to the table: 5+ years of experience in performance-critical systems or kernel development (or equivalent depth of expertise).

Compensation

  • The estimated base salary range for this role to be performed in the US, regardless of the state, is $198,000.00 - $286,000.00 USD.
  • The estimated base salary range for this role to be performed in Canada, regardless of the province, is $194,000.00 - $280,000.00 CAD.

Benefits

  • World-class Benefits.
  • Premier insurance plans, up to 5% 401k matching, flexible paid time off, and more are available to you!
  • We offer very strong compensation packages, including stock options.
  • The total compensation for a candidate will also include annual target bonus, equity, and benefits, with equity making up a significant portion of your total compensation.
  • Please note that specific benefit packages may vary based on your location.

Company info

  • We are a progressive and agile team with some of the industry's best engineering and product leaders.

This listing is sourced directly from Modular's careers page and normalized into a canonical job model.