Twelve Labs

Computational Linguist, AI Evaluation

San Francisco

Sponsorship not specifiedDetected 6 days ago

PythonSnowflakeDatabricksAWSMachine LearningData EngineeringNLPLLMsProject ManagementResearchCommunicationCollaboration

About the role

You will also be responsible for automating as much of the repetitive partnership and annotation-quality-evaluation work as possible.
Position is hybrid in San Francisco - onsite Tuesdays & Thursdays.

TwelveLabs builds the intelligence layer to change that.
We have raised more than $210 million from NEA, Radical Ventures, Amazon, NVIDIA, Snowflake, Databricks, Index Ventures, NAVER Ventures, Korea Investment Partners, Quadrille Capital, Red Bull Ventures, and AI pioneers including Fei-Fei Li, Silvio Savarese, and Alexandr Wang.
Building technology that understands the world in all its complexity requires people who see it from every angle.
Come build it with us!
Define and build evaluation protocols for video-language model quality, working with Research and Product teams to translate ambiguous quality questions into measurable, repeatable benchmarks or evaluation flows.
Design and execute video-language data collection and labeling projects, automating repetitive processes so the team can focus on higher-leverage work.
A desire to work cross functionally and to build relationships is critical for success in this position.
Labeling Operations: Design and execute video-language data collection and labeling projects, automating repetitive processes so the team can focus on higher-leverage work.

5+ years of experience working in an AI focused data operations organization.
A proven track record designing and executing large scale data projects, including gathering, labeling, and post-processing data.
The ability to analyze messy and complex data, identify overarching patterns, and distill your findings into crisp annotation guidelines or other accessible documentation.
Proficiency with Python, agentic coding, or other popular industry tools for automation.

Experience in data collection and labeling for multimodal language models.
Experience working with research scientists and engineers.
Experience planning and operating new data tools and labeling systems.
Expertise or interest in video-centric domains, such as sports, advertising, and content creation.
Even if there are a few checkboxes that aren't ticked through your prior experience, we still encourage you to apply!
If you are a 0-1 achiever, a ferocious learner, and a kind and fun team player who motivates others, you will find a home at TwelveLabs.
Join us as we revolutionize video understanding and multimodal AI.

Technical: Python, FFMPEG, AWS (S3, EC2)
Project Management: Linear, Notion, Google Suite, Encord
It is the differences in our cultural, educational, and life experiences that allow us to constantly challenge the status quo.
🤝 An open and inclusive culture and work environment
🚀 Work closely with a collaborative, mission-driven team on cutting-edge AI technology
🏥 Full health, dental, and vision benefits
🌴 Extremely flexible PTO and parental leave policy.
Office closed the week of Christmas and New Years
💪 Monthly wellness stipend

📚 Annual Learning & Development stipend to invest in your growth
We believe the differences in our cultural, educational, and life experiences make our products stronger.
🚆 Transportation stipend (SF onsite/hybrid only)

Video is 90% of the world's data. Most of it is invisible to machines.
TwelveLabs builds the intelligence layer to change that. Our multimodal AI models understand video the way humans do - across sight, sound, and motion - and power production-scale AI workloads across media, entertainment, sports, security, and government.
We are a global company, headquartered in San Francisco with offices in Seoul, New York, and London, and employees around the world. We believe the differences in our cultural, educational, and life experiences make our products stronger. Building technology that understands the world in all its complexity requires people who see it from every angle. We are looking for individuals who are driven by hard problems and want their work to matter. Come build it with us!
Video is 90% of the world's data.
Most of it is invisible to machines.
Our multimodal AI models understand video the way humans do - across sight, sound, and motion - and power production-scale AI workloads across media, entertainment, sports, security, and government.
We are a global company, headquartered in San Francisco with offices in Seoul, New York, and London, and employees around the world.
We are looking for individuals who are driven by hard problems and want their work to matter.
Linear, Notion, Google Suite, Encord

This listing is sourced directly from Twelve Labs's careers page and normalized into a canonical job model.