Nio
LLM Algorithmic Optimization Engineer
San Jose-US · Full-time
Sponsorship not specified$143k-$186kDetected 46 days ago
PythonC++AlgorithmsLinuxDeep LearningNLPComputer VisionLLMsResearchCommunication
About the role
- JOB DESCRIPTION About NIO NIO is a pioneer and a leading company in the premium smart electric vehicle market.
- About NIO NIO is a pioneer and a leading company in the premium smart electric vehicle market.
Responsibilities
- Conduct research and apply cutting-edge technologies to optimize Large Language Models (LLMs) and multimodal models, exploration and implementation of the core algorithmic optimization on heterogeneous architectures, for highly efficient LLM inference as well as deployment across distributed and heterogeneous hardware environments.
- Collaborate with cross-functional teams to ensure the integration of optimized models into real-world automotive applications.
Requirements
- Currently pursuing or completed a PhD or Master's degree in Computer Science, Computer Engineering, Applied Mathematics, Communications, Electronics, or a related field with relevant research projects and publications.
- Strong understanding of GPU/NPU architecture and optimization techniques to identify and address bottlenecks.
- Proficiency in Python and experience with AI-related training and inference tools such as PyTorch.
- Proficiency in C/C++ programming, familiar with at least one commonly used LLM inference engines.
- Hands-on experience with model-serving frameworks such as Open Neural Network Exchange (ONNX).
- Proficient in LLM and VLM architectures and algorithms, familiar with transformer based NLP / Audio / CV algorithms and technologies.
- Preferred Qualification:
- Experience in inference optimization techniques of deep learning models or libraries on hardware architectures
- Compensation:
Nice to have
- Ph.D. in computer science, artificial intelligence, or related fields
- or Masters degree + 3 years of relevant industry experience
- Familiar with microkernel architecture, Linux kernel, hypervisor, middleware, and application framework
- Those who have good publication records and have published high impact, innovative papers are preferred
- Familiarity with debugging code in distributed computing environments.Experience in LLM inference optimization on resource constrained edge devices is a plus.
Skills
- NIO is a pioneer and a leading company in the premium smart electric vehicle market.
Compensation
- Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.
- Please note that the compensation details listed in US role postings reflect the base salary only. It does not include discretionary bonus, equity, or benefits.
- The US base salary range for this full-time position is $143,200.00 - $186,000.00.
Benefits
- Along with competitive pay, as a full-time NIO employee, you are eligible for the following benefits on the first day you join NIO:
- CIGNA EPO, HSA, and Kaiser HMO medical plans with $0 for Employee Only Coverage.
- Dental (including orthodontic coverage) and vision plan.
- Company Paid HSA (Health Savings Account) Contribution when enrolled in the High Deductible CIGNA medical plan
- Healthcare and Dependent Care Flexible Spending Accounts (FSA)
- Company paid Basic Life, AD&D, short-term and long-term disability insurance
- Sick and Vacation time
- Paid Parental Leave for first 8 weeks at full pay (eligible after 90 days of employment with NIO)
- Paid Disability Leave for first 6 weeks at full pay (eligible after 90 days of employment with NIO)
- Voluntary benefits including: Voluntary Life and AD&D options for you, your spouse/domestic partner and dependent child(ren), pet insurance
- Commuter benefits
- Healthjoy mobile benefit app supporting you and your dependents with benefit questions on the go & support with benefit billing questions
This listing is sourced directly from Nio's careers page and normalized into a canonical job model.