Cox Exponential

Research Scientist/Engineer, Efficient ML Systems

SF Bay Area, USA

Sponsorship not specifiedDetected 41 days ago

Distributed SystemsAlgorithmsMachine LearningPyTorchNLPLLMsA/B TestingResearchCommunicationAdaptability

About the role

You will write real systems code, run large-scale experiments, and directly shape how modern LLMs and RL systems are trained and deployed.
Core Responsibilities Research efficient ML systems: Invent and evaluate algorithms and system techniques that improve LLM and agentic RL training and inference efficiency (memory, compute, communication, and stability).
Strong foundation in LLM or large-scale ML training, including Transformers, attention mechanisms, distributed training, and optimization methods.

About the Role As an AI Research Scientist (Efficient ML Systems) at Goaly, you will research and build the systems that make frontier-scale models practical.
This role sits at the intersection of algorithms, systems, and hardware efficiency.You will design and evaluate new training and inference techniques, prototype them in real systems, and push them to production-scale workloads.
Your work will either ship directly into our core platform or lead to publications at top venues such as NeurIPS, ICML, ICLR, or CVPR.This is not a paper-only role.
Design and optimize large-scale agentic RL pipelines, including asynchronous training, experience management, reward modeling, and long-horizon stability.
Design large-scale experiments spanning model architecture, training algorithms, distributed systems, and hardware-aware optimization.
As an AI Research Scientist (Efficient ML Systems) at Goaly, you will research and build the systems that make frontier-scale models practical.
Scale agentic RL: Design and optimize large-scale agentic RL pipelines, including asynchronous training, experience management, reward modeling, and long-horizon stability.
End-to-end experimentation: Design large-scale experiments spanning model architecture, training algorithms, distributed systems, and hardware-aware optimization.
Production & publication: Translate successful ideas into production-ready systems and/or publish them at top-tier conferences with full internal support.

Requirements Ph.D. or Master's degree in CS, AI, Systems, or related fields (Exceptional undergraduates with strong research capabilities may be considered).

Bonus Points First-author publications at top conferences (NeurIPS, ICML, ICLR, CVPR, ACL).

About Goaly At Goaly, our mission is to make custom AI affordable for every business.
Our founding team comes from the front lines of top AI labs and tech giants (Meta MSL, TikTok AI, Google DeepMind, xAI, Microsoft Research, etc.), where we built large-scale training infrastructure powering trillion-parameter models and scaled GenAI models to a global user base.
a platform that makes training and adapting custom AI affordable for all modern companies, not just Big Tech.
To get a taste of what we are doing, see our first tech blog.

This listing is sourced directly from Cox Exponential's careers page and normalized into a canonical job model.