Lumalabs Ai

Lumalabs Ai

Applied Research Scientist / Engineer

New York, USA

Sponsorship not specifiedDetected 30 days ago
PythonDistributed SystemsFull-Stack DevelopmentKubernetesMachine LearningDeep LearningPyTorchNLPResearchCollaboration

About the role

  • You'll sit at the intersection of research, product, and partnerships, helping close the gap between state-of-the-art and production-ready.
  • Your mission is to make our video foundation models more expressive, controllable, and personalized - solving the "last mile" challenges demanded by top-tier creative workflows.

Responsibilities

  • Controllability and Features: You will leverage a toolkit spanning SFT, RL, personalization, distillation, control adapters, and more, to develop and maintain model variants purpose-built for user environments and creative partners.
  • You will leverage proprietary, vertical-specific datasets to create specialized finetunes and improve future training recipes, ensuring our models rely on data that reflects real-world use cases.
  • End-User Quality: You will define and drive end-user quality - setting success metrics, building user-aligned evaluations, and iterating on the model/data/evals loop to meet strict fidelity and reliability targets in specific enterprise verticals.
  • Cross-functional Collaboration: Partner closely with Product, Research, and Design to translate creative intent and user feedback into model behavior, intuitive controls, and production-ready capabilities for users and partners.
  • You will leverage a toolkit spanning SFT, RL, personalization, distillation, control adapters, and more, to develop and maintain model variants purpose-built for user environments and creative partners.
  • You will define and drive end-user quality - setting success metrics, building user-aligned evaluations, and iterating on the model/data/evals loop to meet strict fidelity and reliability targets in specific enterprise verticals.
  • Partner closely with Product, Research, and Design to translate creative intent and user feedback into model behavior, intuitive controls, and production-ready capabilities for users and partners.
  • This is a foundational opportunity to refine, personalize, and build the final capabilities and control interface of Luma's foundation models and drive real-world value.
  • About Luma AI Luma's mission is to build multimodal AI to expand human imagination and capabilities.
  • About the Role This is a foundational opportunity to refine, personalize, and build the final capabilities and control interface of Luma's foundation models and drive real-world value.

Requirements

  • ML Expert: Strong ML fundamentals with deep experience in visual generative models (diffusion/transformers or related architectures).
  • Familiarity with large-scale training infrastructure and distributed systems (Ray, Slurm, Kubernetes).

Benefits

  • To go beyond language models and build more aware, capable, and useful systems, the next step function change will come from vision.
  • Strong Python and deep learning engineering skills (ideally PyTorch), comfortable moving between research prototypes and production systems.
  • Bonus Points Contributions to state-of-the-art models in image/video generation.

Company info

  • So, we are working on training and scaling up multimodal foundation models for systems that can see and understand, show and explain, and eventually interact with our world to effect change.

This listing is sourced directly from Lumalabs Ai's careers page and normalized into a canonical job model.