Harmonic
Research Engineer, Training & Inference
Palo Alto
Sponsorship not specifiedDetected 75 days ago
PythonC++Node.jsMachine LearningTensorFlowPyTorchLLMsResearchCommunication
About the role
- This ownership spans from low-level environment simulators and custom communication primitives to our distributed training loops and inference engines.
- We are seeking engineers who view existing libraries as a baseline and the hardware speed itself as the true target.
- You will be responsible for the architecture powering our agents, with a relentless focus on maximizing the throughput of our reinforcement learning and production workflows.
Responsibilities
- Total Stack Ownership: Maintain and optimize our proprietary RL training and serving infrastructure.
- Unlike labs that operate primarily through high-level wrappers, we own the entirety of our RL stack.
Requirements
- 2+ years of relevant, hands-on industry experience
- Proficiency in Python
- Proficiency in either:
- You have the authority to refactor any layer-from the Python API down to the CUDA kernels-to achieve peak performance for foundation model workloads.
Nice to have
- MS or PhD in Computer Science, Mathematics, or a related field.
- 5+ years of relevant, hands-on industry experience
- Proficiency in C++
- Experience writing or improving kernels (Triton, CuTeDSL, TileLang, CUDA, CUTLASS, ThunderKittens) to resolve low-level bottlenecks.
- Proven success deploying performant inference at scale using open-source or custom inference engines, routers, etc.
- Direct experience scaling models via FSDP, Tensor Parallelism, or related sharding techniques on multi-node GPU clusters.
Benefits
- 100% employer-paid health, vision, and dental benefits for employees and 50% coverage for dependents.
- Harmonic offers varied health coverage options to select what is best for you and your family.
- Health Savings Account (HSA) available for qualifying health plans
- Optimized Training: maximize the throughput of our reinforcement learning system from data generation to model training with sharded multi-node training and inference algorithms.
- High-Performance Serving: optimize our inference stack for high-throughput reinforcement learning and low-latency LLM production traffic.
Company info
- At Harmonic, we are building a mathematical reasoning engine that operates with absolute precision.
- While most AI makes maximum-likelihood guesses, Harmonic's Aristotle uses Lean 4 and reinforcement learning to verify its reasoning and results.
- Following our Gold Medal-level performance on the 2025 International Math Olympiad (IMO) and the successful resolution of long-standing open problems, we are proving that AI can master the most rigorous domains of human thought.
- Backed by some of the world's most prominent investors, we are intentionally scaling an elite technical team.
- Visit our company blog https://harmonic.fun/news to learn more about what we are working on!
- We are developing reinforcement learning systems at a scale where standard abstractions frequently fail.
Equal opportunity
- Harmonic is committed to diversity and inclusivity in the workplace.
- We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or any other legally protected status.
- equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or any other legally protected status.
Apply directly at Harmonic →Create a free account for alerts like thisView Harmonic immigration profile
This listing is sourced directly from Harmonic's careers page and normalized into a canonical job model.