LM Studio
Systems Engineer (C++)
New York City
Sponsorship not specifiedDetected 55 days ago
C++RESTLLMsSystems Engineering
About the role
- We are hiring a C++ Systems Software Engineer in New York City.
- You will profile, debug, and tune the execution paths that make local AI fast and dependable, and our software well architected and maintainable.
Responsibilities
- Extend our LLM engine integrations and build platform-aware performance features for desktop operating systems.
- Implement resilient IPC, resource management, and scheduling logic to support concurrent model execution.
- Improve our build, packaging, and release infrastructure for native components.
- Collaborate with the rest of the team to deliver cohesive and recognizable user experiences.
- wiring our C++ runtime to GPU backends, vendor SDKs, and operating-system services to support user-facing applications.
- You will implement and harden system-level code (threading, memory, files, IPC, scheduling) and integrate platform acceleration paths (Metal, CUDA, Vulkan) across macOS, Windows, and Linux.
- You design, build, and optimize the core native runtime that powers LM Studio and the C++ libraries powering the app and our APIs.
- You will work across our runtime, LLM engines, llama.cpp/MLX integrations, build infrastructure, and the future of our on-device AI software.
- Your work centers on system and library integration: wiring our C++ runtime to GPU backends, vendor SDKs, and operating-system services to support user-facing applications.
Requirements
- Thinks in systems and knows how to reason about performance, reliability, and user experience end-to-end.
- Proven maturity designing internal and external APIs that are ergonomic, maintainable, and stable over time.
- C++11 (or newer) expertise with RAII as a default mindset and modern language/library proficiency.
- Deep knowledge of concurrency, memory management, file systems, and network protocols.
- Experience optimizing performance with profilers, tracing, and hardware counters.
- 4+ years building production C++ systems software across macOS or Linux.
Compensation
- Competitive salary and generous equity grants
Benefits
- Competitive salary and generous equity grants
- Great medical, vision, dental healthcare plans
Company info
- We are looking for engineering excellence and strong values / cultural fit.
Apply directly at LM Studio →Create a free account for alerts like thisView LM Studio immigration profile
This listing is sourced directly from LM Studio's careers page and normalized into a canonical job model.