LawZero
Senior Distributed ML Engineer
Montreal · Senior
Sponsorship not specifiedDetected 90 days ago
Vector DatabasesAWSGCPAzureCloud PlatformsDockerKubernetesgRPCMachine LearningPyTorchAgentic AIResearch
About the role
- In this role, you will work closely with ML research scientists to solve difficult training and inference problems using very large models.
- The title of Engineer is used for reference purposes and may or may not be the official title of the applicant based on jurisdiction.
- Its scientific direction is based on new research and methods proposed by Professor Yoshua Bengio, the most cited AI researcher in the world.
Responsibilities
- Collaborate with researchers to accelerate research, model training and inference, and facilitate the use of large-scale models in distributed computing environments.
- Investigate performance bottlenecks, profile research experiment code, debug reported issues, and optimize the utilization of computing resources.
- Develop tools and libraries to simplify and orchestrate the use of distributed computing resources for research experiments.
- Establish, document, and maintain best practices for large-scale, distributed ML model development workflows.
- Ability to collaborate effectively with cross-functional teams, document best practices, and stay updated with the latest advancements in ML and software development.
- LawZero is a non-profit organization committed to advancing research and creating technical solutions that enable safe-by-design AI systems.
Requirements
- 3+ years of experience in designing and implementing distributed ML training frameworks, with recent experience using e.g. Megatron, DeepSpeed, HuggingFace Accelerate, FSDP, vLLM, and/or verl.
Skills
- Experience with cloud platforms (e.g., AWS, GCP, Azure) and workload managers (e.g., Ray, SLURM).
- Experience with GPU profiling tools (e.g. PyTorch profiler, PyProf, NVIDIA Nsight).
- Familiarity with containerization tools (e.g., gRPC, Docker, Kubernetes).
- Familiarity with data infrastructures and platforms (e.g., vector databases).
- A track record of contributing to high-quality research projects in deep learning.
- The opportunity to contribute to a unique mission with a major impact.
- Comprehensive health benefits (including mental health and wellness management account)
- 20 days of vacation per year upon start
- Employer contribution of 4% to your retirement savings, with no required employee matching
- A team of passionate world-class experts in their field
Compensation
- 20 days of vacation per year upon start
Benefits
- Additional compensation totaling 8% of your salary to apply towards additional retirement savings or bonuses (independent of group and individual performance)
Company info
- We welcome applications from highly qualified individuals interested in working towards our mission in a respectful, inclusive and collaborative setting.
Apply directly at LawZero →Create a free account for alerts like thisView LawZero immigration profile
This listing is sourced directly from LawZero's careers page and normalized into a canonical job model.