Modular

Modular

Senior AI Graph Compiler Engineer

USA · Senior

Sponsorship not specified$198k-$286kDetected 62 days ago
PythonMachine LearningPyTorchCustomer Success

About the role

  • The graph compiler is a central piece of MAX, which executes ML models at state-of-the-art performance across multiple hardware platforms.
  • Modular's compiler stack is vertically integrated, from ML serving layer, through the Python API, down to highly tuned kernel implementations - opening up opportunities for optimization not available in competing technologies.
  • You will improve the performance and usability of the graph compiler, creating a joyful developer experience.

Responsibilities

  • Design and develop compiler optimizations to improve inference efficiency across CPUs, GPUs, and ML accelerators, including kernel fusion, memory planning, and shape optimization.
  • Collaborate with the kernels, serving, and Mojo compiler teams to implement core technologies that deliver end-to-end performance across a variety of heterogeneous hardware platforms.
  • Write design documents for new features and drive for alignment on designs with cross-functional teams.
  • Team Building Events.

Requirements

  • 5+ years of software engineering experience.
  • Proficiency in C++.
  • Knowledge of and experience working with MLIR and LLVM.
  • Experience with ML parallel / distributed programming, heterogeneous ML computation, and/or code generation.
  • Knowledge of basic ML implementation and modeling techniques and familiarity with ML frameworks like PyTorch, JAX, or TensorFlow.
  • Helpful but not required: Knowledge of and experience working with MLIR and LLVM.

Skills

  • map hardware-agnostic graphs of computational operators onto hardware-specific graphs of devices and nodes.

Compensation

  • The estimated base salary range for this role to be performed in the US, regardless of the state, is $198,000.00 - $286,000.00 USD.
  • The estimated base salary range for this role to be performed in Canada, regardless of the province, is $194,000.00 - $280,000.00 CAD.

Benefits

  • World-class Benefits.
  • Premier insurance plans, up to 5% 401k matching, flexible paid time off, and more are available to you!
  • We offer very strong compensation packages, including stock options.
  • The total compensation for a candidate will also include annual target bonus, equity, and benefits, with equity making up a significant portion of your total compensation.
  • Experience working with compilers for machine learning frameworks.
  • Please note that specific benefit packages may vary based on your location.

Company info

  • Collaborate with the customer success team and engage with customers to understand their performance requirements and use cases.
  • We are a progressive and agile team with some of the industry's best engineering and product leaders.
Apply directly at Modular →Create a free account for alerts like thisView Modular immigration profile

This listing is sourced directly from Modular's careers page and normalized into a canonical job model.