Tencent
Sr. AI Inference Systems Engineer
US-California-Palo Alto · Senior
Sponsorship not specified$125k-$235kDetected 20 days ago
Distributed SystemsDeep LearningTensorFlowPyTorchLLMsCybersecuritySystems EngineeringResearchLeadershipCommunicationCollaboration
About the role
- Location State(s) US-California-Palo Alto The expected base pay range for this position in the location(s) listed above is $124,800.00 to $235,000.00 per year.
Responsibilities
- Lead the optimization of the full inference pipeline for Large Models (LLM, Multimodal); focus on KV Cache storage strategies, Router architecture design, and collaborative operator optimization to maximize throughput and minimize latency.
- Conduct in-depth research into the underlying inference logic of various hardware accelerators; evaluate architectural suitability for real-time, batch, and streaming inference scenarios to develop standardized optimization schemes.
- Lead efforts to overcome key technical bottlenecks in inference optimization; design technical roadmaps and mentor team members to build a robust AI inference technical ecosystem.
Requirements
- significant professional experience in AI inference optimization or heterogeneous computing.
- Stay current with global evolutions in inference technology and computing architectures, with the ability to objectively evaluate different technical paths.
Nice to have
- Experience in tuning ultra-large-scale inference clusters or driving AI inference productization
- high-level publications or core patents in relevant fields are a plus.
- US-California-Palo Alto
- Equal Employment Opportunity at Tencent
- As an equal opportunity employer, we firmly believe that diverse voices fuel our innovation and allow us to better serve our users and the community.
- We foster an environment where every employee of Tencent feels supported and inspired to achieve individual and common goals.
- experience in optimizing ultra-large-scale models is highly preferred.
Skills
- Business Unit
- Cloud & Smart Industries Group (CSIG) is responsible for promoting the company's cloud and industry Internet strategy.
- What the Role Entails
Compensation
- Location State(s) US-California-Palo Alto The expected base pay range for this position in the location(s) listed above is $124,800.00 to $235,000.00 per year.
Apply directly at Tencent →Create a free account for alerts like thisView Tencent immigration profile
This listing is sourced directly from Tencent's careers page and normalized into a canonical job model.