Lumalabs Ai
Research Scientist / Engineer - Controllability, Personalization & Productization
New York, USA
Sponsorship not specifiedDetected 359 days ago
Distributed SystemsFull-Stack DevelopmentKubernetesMachine LearningPyTorchNLPResearchCollaboration
About the role
- You'll sit at the intersection of research, product, and partnerships, helping close the gap between generalist capability and production needs.
- Your mission is to make our video foundation models more expressive, controllable, and personalized - solving the "last mile" challenges demanded by top-tier creative workflows.
Responsibilities
- Controllability and Features: You will use SFT, RL, distillation, and adapter-based methods to give Luma's models precise control and creative capabilities for high-fidelity, partner-grade workflows.
- End-User Quality: You will define and drive end-user quality - setting success metrics, building user-aligned evaluations, and iterating on the model/data/evals loop to meet strict fidelity and reliability targets in specific verticals.
- Cross-functional Collaboration: You will partner with Product and Design to turn creative intent and user feedback into clear specs and shippable model behaviors, delivering intuitive control and dependable capabilities for users and partners.
- You will define and drive end-user quality - setting success metrics, building user-aligned evaluations, and iterating on the model/data/evals loop to meet strict fidelity and reliability targets in specific verticals.
- You will partner with Product and Design to turn creative intent and user feedback into clear specs and shippable model behaviors, delivering intuitive control and dependable capabilities for users and partners.
- This is a foundational opportunity to refine, personalize, and build the final capabilities and control interface of Luma's foundation models and drive real-world value.
- You treat end users and partners as collaborators and enjoy solving specific "last mile" problems - not just optimizing public metrics.
- Experience collaborating with creative partners (VFX, animation, film, design tools).
- Track record building workflows/tools that materially improve iteration speed and evaluation rigor.
Requirements
- You are a product-obsessed researcher/engineer.
- Hands-on experience with PyTorch and large model training.
- Familiarity with large-scale training infrastructure and distributed systems (Ray, Slurm, Kubernetes).
- You will work as a fullstack researcher across modeling, data, systems, and evaluation to translate foundational capabilities into the personalized and high-fidelity tools required by top-tier creative production.
Benefits
- Bonus Points Contributions to state-of-the-art models in image/video generation.
- Personalization: You will use context management, PEFT, and preference learning to embed domain expertise and long-horizon memory into our models.
- Who You Are Strong foundation in machine learning with deep experience in visual generative models (diffusion/transformers or related architectures).
Apply directly at Lumalabs Ai →Create a free account for alerts like thisView Lumalabs Ai immigration profile
This listing is sourced directly from Lumalabs Ai's careers page and normalized into a canonical job model.