Ifm Us
Research Scientist - World Modeling
Sunnyvale, CA
H1B sponsorship available$150k-$450kDetected 445 days ago
Deep LearningData EngineeringLLMsResearchCommunicationCollaborationProblem Solving
About the role
- We are the AllWorld Team under the Institute of Foundation Model (IFM) at MBZUAI.
- At AllWorld, we are pioneering the development of the PAN (Physical, Agentic, and Networked) world models -the next-generation foundation models to unlock machine intelligence beyond lingual.
- Our mission is to tackle the fundamental challenges of world modeling and establish a new paradigm for next-generation machine reasoning.
Responsibilities
- Develop the foundational world model to accurately simulate the physical world.
- Collaborate with engineering and data teams to tackle key challenges in training the world model on large-scale clusters.
- Develop metrics and evaluation benchmarks to better assess model performance.
- Design and implement a scalable and efficient data annotation pipeline to ensure high-quality labeled data for training and evaluation.
- Optimize inference efficiency to enable real-time interaction.
- Scalable Training Systems: Develop and optimize infrastructure for training multimodal LLMs and video diffusion models at massive scale.
- Efficient Data Pipelines: Build scalable video data pipelines and annotation frameworks to support high-quality training data.
- Visual Tokenization: Develop methods for discretizing visual features into tokens for improved model representation.
- Experiences in building and optimizing large-scale video data pipelines.
- Ability to navigate ambiguity and drive projects in rapidly evolving research areas.
Requirements
- Hands-on experience with state-of-the-art video generative models (e.g., Sora, Veo2, MovieGen, CogVideoX, etc.).
Compensation
- $150k-$450k
Benefits
- Include *Comprehensive medical, dental, and vision benefits *Bonus *401K Plan *Generous paid time off, sick leave and holidays *Paid Parental Leave *Employee Assistance Program *Life insurance and disability
- Strong systems and engineering expertise in deep learning frameworks such as PyTorch.
Visa & Work Authorization
- This position is eligible for visa sponsorship.
This listing is sourced directly from Ifm Us's careers page and normalized into a canonical job model.