Nio
AI Infrastructure Engineer
San Jose-US · Full-time
Sponsorship not specified$192k-$250kDetected 32 days ago
C++Deep LearningTensorFlowPyTorchNLPLLMsSignal ProcessingCommunicationCollaborationAdaptability
About the role
- JOB DESCRIPTION About NIO NIO is a pioneer and a leading company in the premium smart electric vehicle market.
- This position is focused on designing, implementing, and delivering production-grade software that powers real-world applications of Large Language Models (LLMs) and Vision-Language Models (VLMs).
- This is an exciting opportunity for an engineer who thrives at the intersection of AI systems, hardware acceleration, and large-scale robust deployment, and who wants to see their contributions ship in production, at scale.
Responsibilities
- Develop and optimize custom kernels and operators for specific hardware accelerators (GPU, NPU, DSP, etc.), improving throughput, latency, and memory efficiency.
- Partner with system and hardware teams to ensure tight hardware-software integration and optimal performance across diverse compute environments.
- Define and drive the evolution roadmap for LLM/VLM inference in the AIOS stack, ensuring scalability and adaptability to new workloads.
Requirements
- Direct experience in LLM/VLM model internals, including Transformer-based architectures, inference bottlenecks, and optimization techniques.
- Strong expertise in performance engineering: kernel development, parallelism strategies, memory optimization, and distributed inference systems.
- Strong programming skills in C/C++, with a track record of delivering high-performance, production-grade software.
- Excellent communication and collaboration skills, with the ability to work across cross-functional teams.
- 5+ years of hands-on software development experience in building and optimizing AI inference systems at scale.
Nice to have
- Master's or PhD degree in Computer Science, Electrical/Computer Engineering, or related fields, plus 5 years industry experience
- Expertise in hardware-aware model optimization (e.g., kernel fusion, mixed precision, quantization, pruning).
- Familiarity with edge and embedded AI, including real-time constraints and limited-resource optimization.
- Contributions to widely used AI frameworks, libraries, or performance-critical software (open source or proprietary).
Compensation
- The US base salary range for this full-time position is $192,100.00 - $249,600.00.
- Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.
- Please note that the compensation details listed in US role postings reflect the base salary only. It does not include discretionary bonus, equity, or benefits.
Benefits
- Along with competitive pay, as a full-time NIO employee, you are eligible for the following benefits on the first day you join NIO:
- Anthem Blue Cross, HSA, and Kaiser HMO medical plans with $0 for Employee Only Coverage.
- Dental (including orthodontic coverage) and vision plan.
- Company Paid HSA (Health Savings Account) Contribution when enrolled in the High Deductible Anthem Blue Cross medical plan
- Healthcare and Dependent Care Flexible Spending Accounts (FSA)
- Company paid Basic Life, AD&D, short-term and long-term disability insurance
- Sick and Vacation time
- Paid Parental Leave for first 8 weeks at full pay (eligible after 90 days of employment with NIO)
- Paid Disability Leave for first 6 weeks at full pay (eligible after 90 days of employment with NIO)
- Voluntary benefits including: Voluntary Life and AD&D options for you, your spouse/domestic partner and dependent child(ren), pet insurance
- Commuter benefits
This listing is sourced directly from Nio's careers page and normalized into a canonical job model.