Samsung Semiconductor

Principal Engineer, AI Serving Framework Architect (Software)

San Jose, California, United States · Principal

Sponsorship not specified$219k-$351kDetected 12 days ago

PythonC++AlgorithmsVector DatabasesPyTorchNLPLLMsRAGAgentic AIExcelRecruitingResearchCommunication

About the role

Please Note: To provide the best candidate experience amidst our high application volumes, each candidate is limited to 10 applications across all open jobs within a 6-month period.
Advancing the World's Technology Together Our technology solutions power the tools you use every day--including smartphones, electric vehicles, hyperscale data centers, IoT devices, and so much more.
We believe innovation and growth are driven by an inclusive culture and a diverse workforce.

As a Tech Lead, leading research teams in Korea and proposing technical direction
Proposing SW design for implementing the derived optimization algorithms on open-source platforms such as vLLM
Led a project to build and optimize a Large Language Model (LLM) Inference Software Stack on a multi-rack scale system to deliver AI Inference services to over 100,000 users.
You approach challenges with curiosity and resilience, seeking data to help build.
You're collaborative, building relationships, humbly offering support and openly welcoming approaches.

PhD in Computer Science or a related field with 10+ years of experience in AI Serving Framework for large-scale computing, with focusing on the AI workloads.
Extensive experience in designing AI Inference Software Stacks for heterogeneous devices.In-depth understanding of the internal architecture and operation mechanisms of inference engines such as vLLM.
Proficiency in AI Inference System Profiling and optimization.
Knowledge and practical experience with future AI workloads, including reasoning models, multi-modal solutions, AI agents, and world models.
Strong understanding of compute, memory, and networking bottlenecks in AI systems.
Required skillsets: PyTorch, Python, and C++

This is in addition to our diverse package of benefits centered around the wellbeing of our employees and their loved ones.
In addition to the usual Medical/Dental/Vision/401k, our inclusive rewards plan empowers our people to care for their whole selves.
Enjoy Time Away You'll start with 4+ weeks of paid time off a year, plus holidays and sick leave, to rest and recharge.
Care for Family Whatever family means to you, we want to support you along the way-including a stipend for fertility care or adoption, medical travel support, and virtual vet care for your fur babies.
Prioritize Emotional Wellness With on-demand apps and free confidential therapy sessions, you'll have support no matter where you are.
Embrace Flexibility Benefits are best when you have the space to use them.
That's why we facilitate a flexible environment so you can find the right balance for you.
Our onsite Café and gym, plus virtual classes, make it easier.

Employment Policy
Samsung Semiconductor takes pride in being an equal opportunity workplace dedicated to fostering an environment where all individuals feel valued and empowered to excel, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status.
When selecting team members, we prioritize talent and qualities such as humility, kindness, and dedication.
We extend comprehensive accommodations throughout our recruiting processes for candidates with disabilities, long-term conditions, neurodivergent individuals, or those requiring pregnancy-related support.

This listing is sourced directly from Samsung Semiconductor's careers page and normalized into a canonical job model.