WEKA
Tech Lead - AI Inference
U.S
Sponsorship not specifiedDetected 28 days ago
PythonC++KubernetesMachine LearningNLPLLMsSystems EngineeringResearchLeadershipCollaborationMentoring
About the role
- In this role, you will bridge the gap between complex research and production-grade engineering, while cultivating a high-performing team culture.
- It's about lifting one another up to succeed collectively.
- We challenge each other and conduct positive conflict resolution.
Responsibilities
- Guide a team of engineers through design, implementation, and delivery of high-throughput, low-latency LLM inference systems, setting high standards for code quality, architecture, and reliability.
- At WEKA, we are committed to building a diverse, inclusive and authentic workplace.
Requirements
- Deep AI Inference Background: Hands-on expertise with LLM serving systems - KV cache reuse, disaggregated prefill/decode, continuous batching, and multi-tier GPU memory hierarchies (HBM → NVMe).
- Hands-on expertise with LLM serving systems - KV cache reuse, disaggregated prefill/decode, continuous batching, and multi-tier GPU memory hierarchies (HBM → NVMe).
Nice to have
- 5+ years of professional software engineering, with proven experience leading engineers and owning complex production systems - ideally in AI/ML infrastructure or high-performance computing.
- Strong Python and C++ skills (Rust a plus), with a solid grasp of CUDA, GPU memory management, and high-performance I/O - including GPUDirect Storage (GDS), RDMA, and NVMe data paths.
- Systems Engineering Depth: Strong Python and C++ skills (Rust a plus), with a solid grasp of CUDA, GPU memory management, and high-performance I/O - including GPUDirect Storage (GDS), RDMA, and NVMe data paths.
Skills
- What You'll Work On
Compensation
- USA Residents Only: The Total Compensation hiring wage range for this position which the Company reasonably and in good faith expects to pay for the position in the specified geographic areas or locations.
Benefits
- Demonstrated ability to mentor and develop engineers - running effective 1:1s, supporting career growth, and balancing technical execution with long-term team health.
Company info
- We take full ownership, always-even when things don't go as planned.
- We lead with integrity, show up with responsibility & ownership, and hold ourselves and each other to the highest standards.
- We question the status quo, push boundaries, and take smart risks when needed.
- We welcome challenges and embrace debates as opportunities for growth, turning courage into fuel for innovation.
- True collaboration isn't only about working together.
- We are team-oriented and communicate with empathy and respect.
- We are being transparent about our goals and results.
- And together, we're unstoppable.
- Our customers are at the heart of everything we do.
- We actively listen and prioritize the success of our customers, and every decision we make is driven by how we can better serve, support, and empower them to succeed.
- When our customers win, we win.
Equal opportunity
- WEKA is an equal opportunity employer that prohibits discrimination and harassment of any kind.
This listing is sourced directly from WEKA's careers page and normalized into a canonical job model.