LawZero

LawZero

Senior Distributed ML Engineer

Montreal · Senior

Sponsorship not specifiedDetected 90 days ago
Vector DatabasesAWSGCPAzureCloud PlatformsDockerKubernetesgRPCMachine LearningPyTorchAgentic AIResearch

About the role

  • In this role, you will work closely with ML research scientists to solve difficult training and inference problems using very large models.
  • The title of Engineer is used for reference purposes and may or may not be the official title of the applicant based on jurisdiction.
  • Its scientific direction is based on new research and methods proposed by Professor Yoshua Bengio, the most cited AI researcher in the world.

Responsibilities

  • Collaborate with researchers to accelerate research, model training and inference, and facilitate the use of large-scale models in distributed computing environments.
  • Investigate performance bottlenecks, profile research experiment code, debug reported issues, and optimize the utilization of computing resources.
  • Develop tools and libraries to simplify and orchestrate the use of distributed computing resources for research experiments.
  • Establish, document, and maintain best practices for large-scale, distributed ML model development workflows.
  • Ability to collaborate effectively with cross-functional teams, document best practices, and stay updated with the latest advancements in ML and software development.
  • LawZero is a non-profit organization committed to advancing research and creating technical solutions that enable safe-by-design AI systems.

Requirements

  • 3+ years of experience in designing and implementing distributed ML training frameworks, with recent experience using e.g. Megatron, DeepSpeed, HuggingFace Accelerate, FSDP, vLLM, and/or verl.

Skills

  • Experience with cloud platforms (e.g., AWS, GCP, Azure) and workload managers (e.g., Ray, SLURM).
  • Experience with GPU profiling tools (e.g. PyTorch profiler, PyProf, NVIDIA Nsight).
  • Familiarity with containerization tools (e.g., gRPC, Docker, Kubernetes).
  • Familiarity with data infrastructures and platforms (e.g., vector databases).
  • A track record of contributing to high-quality research projects in deep learning.
  • The opportunity to contribute to a unique mission with a major impact.
  • Comprehensive health benefits (including mental health and wellness management account)
  • 20 days of vacation per year upon start
  • Employer contribution of 4% to your retirement savings, with no required employee matching
  • A team of passionate world-class experts in their field

Compensation

  • 20 days of vacation per year upon start

Benefits

  • Additional compensation totaling 8% of your salary to apply towards additional retirement savings or bonuses (independent of group and individual performance)

Company info

  • We welcome applications from highly qualified individuals interested in working towards our mission in a respectful, inclusive and collaborative setting.

This listing is sourced directly from LawZero's careers page and normalized into a canonical job model.