Cohere

Senior Member of Technical Staff, Web Data

Toronto · Staff+ · Full-time

Sponsorship not specifiedDetected 50 days ago

PythonPandasSparkData EngineeringNLPA/B TestingResearch

About the role

Cohere is the leading security-first enterprise AI company.
Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.
In this role, you will work extensively with large-scale web corpora, transforming raw, noisy internet data into high-quality training data for pretraining.

We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.
We're training and deploying frontier models for enterprises who are building AI systems.
We obsess over what we build.
As a Senior Member of Technical Staff specializing in web data for pre-training, you will play a pivotal role in developing the large scale web data pipeline that underpins Cohere's advanced language models.
You will own key components of the data pipeline, including extraction, parsing, deduplication, and filtering.
You will also analyze the composition and quality of web data, study its impact on downstream model performance, and collaborate closely with the broader data and evaluation teams to iterate on the training corpus.
Maintain large-scale pipelines for processing web corpora.
Work on filtering and quality-scoring systems to identify high-value web documents.
Develop and maintain highly-performant deduplication pipelines.
Collaborate with cross-functional teams, including researchers and engineers, to ensure data pipelines meet the demands of cutting-edge language models.

Strong software engineering skills, with proficiency in Python and experience building data pipelines.
Familiarity with data processing frameworks such as Apache Spark, Apache Beam, Pandas, or similar tools.
Experience working with large-scale web datasets.
Knowledge of data quality assessment techniques and experimentation with data mixtures.
If you are passionate about transforming data into the foundation of AI systems, this role offers a unique opportunity to make a meaningful impact.

6 weeks of paid vacation (30 working days!)
A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
Full health and dental benefits, including a separate budget for mental health.
RRSP matching, 401K, Pension Scheme.
100% Parental Leave top-up for up to 6 months, for either parent.
Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.
Education & learning stipend for conferences, courses, and coaching.
For those not near an office: a co-working benefit so you can work alongside others in your city.
Everyone receives a $500 home office stipend to set up your workspace properly.

We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.
Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers.
We are a global technology company co-headquartered in Toronto and San Francisco, with key offices in London, New York City, Montreal, Seoul, Germany and Paris.

This listing is sourced directly from Cohere's careers page and normalized into a canonical job model.