Modular
Senior AI Kernel Engineer
USA · Senior
Sponsorship not specified$198k-$286kDetected 176 days ago
C++NLPLLMsCommunicationProblem Solving
About the role
- You can work in our office in Los Altos, CA or remotely from home.
- Onboarding for new hires is conducted in-person in our Los Altos, CA office.
Responsibilities
- Design, implement, and optimize performance-critical kernels for AI inference workloads (e.g., GEMM, attention, communication, fusion).
- Lead kernel-level optimization efforts across single-GPU, multi-GPU, and heterogeneous hardware environments.
- Drive adoption of new hardware features (e.g., Tensor Cores, asynchronous execution, advanced memory spaces).
- Review and mentor other engineers on kernel design, performance tuning, and best practices.
- Team Building Events.
Requirements
- 5+ years of experience in performance-critical systems or kernel development (or equivalent depth of expertise).
- Strong proficiency in C/C++ and low-level programming.
- Extensive hands-on experience with GPU kernel programming (CUDA, HIP, or equivalent).
- Proven track record of delivering measurable performance improvements in production systems.
- Strong problem-solving skills and ability to work independently on complex, ambiguous performance challenges.
- Experience with PTX, assembly-level tuning, or code generation frameworks (e.g., Triton).
- Experience optimizing distributed or multi-GPU inference pipelines.
- Familiarity with custom AI accelerators or domain-specific hardware.
- Experience collaborating directly with hardware or compiler teams.
- What you bring to the table: 5+ years of experience in performance-critical systems or kernel development (or equivalent depth of expertise).
Compensation
- The estimated base salary range for this role to be performed in the US, regardless of the state, is $198,000.00 - $286,000.00 USD.
- The estimated base salary range for this role to be performed in Canada, regardless of the province, is $194,000.00 - $280,000.00 CAD.
Benefits
- World-class Benefits.
- Premier insurance plans, up to 5% 401k matching, flexible paid time off, and more are available to you!
- We offer very strong compensation packages, including stock options.
- The total compensation for a candidate will also include annual target bonus, equity, and benefits, with equity making up a significant portion of your total compensation.
- Please note that specific benefit packages may vary based on your location.
Company info
- We are a progressive and agile team with some of the industry's best engineering and product leaders.
Apply directly at Modular →Create a free account for alerts like thisView Modular immigration profile
This listing is sourced directly from Modular's careers page and normalized into a canonical job model.