The Bot Company

Machine Learning: Multimodal Foundation Models

San Francisco

Sponsorship not specifiedDetected 147 days ago

PythonC++Machine LearningLLMsExcelResearch

About the role

We're a small team of engineers, designers, and operators based in San Francisco.
Our team comes from Tesla, Cruise, OpenAI, Google, Pixar, and many other great companies.
Our team is deliberately lean to promote rapid decision making and do away with bureaucracy and hierarchy.

Improve Cross-Modal Reasoning: Research and implement methods to ensure the model doesn't just "associate" modalities but actually reasons through them (e.g., grounding visual physics in kinematic constraints).
Own the Training Loop End-to-End: Design, run, debug, and iterate on large-scale training experiments
diagnosing failure modes, improving data mixtures, and tightening evaluation to drive measurable gains.
Ship and Iterate on Real Systems: Integrate models into real robotic stacks, build on robot code to deploy your models, and optimize performance for edge inference.
Own the Training Loop End-to-End: Design, run, debug, and iterate on large-scale training experiments; diagnosing failure modes, improving data mixtures, and tightening evaluation to drive measurable gains.
You will work on large multi-modal networks and own the entire stack from data to training and deploying models.
Research and implement methods to ensure the model doesn't just "associate" modalities but actually reasons through them (e.g., grounding visual physics in kinematic constraints).
Design, run, debug, and iterate on large-scale training experiments; diagnosing failure modes, improving data mixtures, and tightening evaluation to drive measurable gains.
Integrate models into real robotic stacks, build on robot code to deploy your models, and optimize performance for edge inference.

Production MLLM Experience: Track record of training and deploying large-scale multimodal models.
If you enjoy understanding systems at all levels, move fast, and think even faster, you'll thrive here.
All roles at The Bot Company demand extreme sharpness and the ability to move fast in high-intensity environments.

Develop architectures where vision, language, and more modalities share a unified representation.

We are building unified foundation models that natively reason across text, image, video, and kinematics to drive intelligent robotic policies.

This listing is sourced directly from The Bot Company's careers page and normalized into a canonical job model.