Coveo
Senior Software Developer – Machine Learning Platform
Montreal (Province of Quebec, Canada) · Senior
Sponsorship not specifiedDetected 7 days ago
PythonJavaSpringDistributed SystemsBackend DevelopmentElasticsearchVector DatabasesAWSCloud PlatformsTerraformMachine LearningComputer VisionLLMs
About the role
- Want to see your work power millions of machine learning predictions every day? Join our Machine Learning Platform team and help bring models, including Large Language Models (LLMs), into production in a reliable and scalable way.
- You'll contribute to a platform that trains thousands of models and serves hundreds of millions of queries daily, while growing your expertise in distributed systems, machine learning infrastructure and agentic workflows.
Responsibilities
- Build the backbone of AI at scale
- Good understanding of distributed systems and scalable application design
Requirements
- Familiarity with Terraform, AWS Bedrock, OpenSearch serverless or other vector databases, LiteLLM or other LLM inference gateways
- Ability to solve problems and debug systems with guidance when needed
Nice to have
- 5+ years of experience in backend development in a cloud environment (Python or Java/Spring preferred, AWS an asset)
Skills
- Contribute to the development lifecycle, including coding, testing, and deployment
- Analyze and help improve the ease of use, observability and reliability of our AI platform
- Participate in maintaining services handling millions of requests and LLM calls per day
- Comfortable learning new tools, technologies, and best practices
Benefits
- Want to see your work power millions of machine learning predictions every day?
- Join our Machine Learning Platform team and help bring models, including Large Language Models (LLMs), into production in a reliable and scalable way.
This listing is sourced directly from Coveo's careers page and normalized into a canonical job model.