CoreWeave
Senior Software Engineer - GPU Kernel Authoring & Optimization
Sunnyvale, CA / Bellevue, WA · Senior
Sponsorship not specified$182k-$242kDetected 5 days ago
PythonC++SpringKubernetesMachine LearningPyTorchLLMsCommunicationCollaborationMicrosoft Office
About the role
- CoreWeave is the top-rated AI-cloud for high-performance GPU infrastructure across AI/ML, visual effects, rendering, and real-time inference.
- Our stack is engineered for speed, scale, and cost-efficiency-an unmatched alternative to traditional hyperscalers.
- At CoreWeave, infrastructure is the product.
Responsibilities
- Implement and maintain benchmarking workflows for end-to-end MLPerf Inference (and Training) runs, including workload setup, cluster configuration, runbooks, and result validation.
- Lead design reviews and drive architecture within the team; decompose multi-service work into clear milestones.
- Mentor junior engineers; review cross-team designs and elevate coding/testing standards.
- You'll partner with product, orchestration, and hardware teams to turn kernel-level wins into end-to-end gains and meet strict P99 SLAs at scale.
- Benchmark rigorously: build reproducible microbenchmarks and roofline analyses, and validate that kernel-level wins translate to end-to-end latency/throughput gains across model-serving stacks (vLLM, TensorRT-LLM, llm-d, SGLang).
- Family-Forming support provided by Carrot
- <a href="https://drive.google.com/
Requirements
- 5+ years of experience building high-performance computing, GPU/accelerator software, or performance-critical systems.
- Hands-on CUDA experience is required-you have written and optimized custom kernels and are fluent with the CUDA programming and memory model.
- Familiarity with model-serving stacks (vLLM, TensorRT-LLM, llm-d, SGLang) and the kernels that dominate their inference cost.
- Experience with alternative accelerators such as Google TPUs and Meta's MTIA.
- Familiarity with kernel-authoring DSLs and nano-compilers such as KNYFE and its Block DSL.
- Experience with Kubernetes at production scale.
Skills
- CoreWeave is The Essential Cloud for AI™.
Compensation
- The base salary range for this role is $182,000 to $242,000.
Benefits
- In addition to a competitive salary, we offer a variety of benefits to support your needs.
- The benefits below reflect our US-based offerings
- Medical, dental, and vision insurance - 100% paid for by CoreWeave
- Company-paid Life Insurance
- Voluntary supplemental life insurance
- Short and long-term disability insurance
- Flexible Spending Account
- Health Savings Account
- Tuition Reimbursement
- Ability to Participate in Employee Stock Purchase Program (ESPP)
- Mental Wellness Benefits through Spring Health
- Paid Parental Leave
- for roles in other locations, benefits vary and are shared during the hiring process.
- The benefits below reflect our US-based offerings; for roles in other locations, benefits vary and are shared during the hiring process.
Company info
- Learn more at www.coreweave.com.
- CRWV) in March 2025.
Apply directly at CoreWeave →Create a free account for alerts like thisView CoreWeave immigration profile
This listing is sourced directly from CoreWeave's careers page and normalized into a canonical job model.