HumanSignal
Delivery Lead
San Francisco, California
Sponsorship not specified$110k-$140kDetected 55 days ago
PythonReactMachine LearningData EngineeringLLMsLogisticsProcurementResearchLeadership
About the role
- HumanSignal specializes in operationally complex, multimodal data collection and annotation - delivering the datasets that frontier AI research requires and remote workforce marketplaces can't.
- Our work spans RLHF, evals, red-teaming, and custom multimodal data creation, all powered by Label Studio Enterprise and built on a foundation of rigorous quality workflows, ethical sourcing, and full data security.
- This role sits at the operational core of that delivery engine - responsible for ensuring our clients get the highest-quality data on time, every time.
Responsibilities
- The day-to-day is intense by design.
- You'll juggle multiple programs at once, each with its own contributors, quality standards, and customer expectations.
- The expectation is simple: own the outcome, no excuses.
- Lead and manage a team of Strategic Project Leads (SPLs) across multiple high-stakes AI data projects simultaneously
- Own delivery outcomes for your projects: throughput, quality, SLA performance, cost efficiency, and customer satisfaction
- Drive delivery across custom data pipelines and expert labeling workflows, translating researcher requirements into clear operational plans
- Collaborate with AI lab researchers and procurement partners to define data strategies, scope programs, and resolve escalations
- Drive systems-level improvements - standardize playbooks, improve tooling, and build infrastructure that makes the team faster and more reliable at scale
- Coach and develop SPLs; ensure high-quality AI Trainer experience and strong contributor retention
- Partner with Product and Engineering to evolve internal tooling, automation, and operational systems
Requirements
- 5+ years in operationally intensive roles (marketplace, data ops, logistics, or similar)
- 1+ year of people management with clear impact on team performance
- Experience owning delivery outcomes across multi-stakeholder, high-velocity projects
- Must be proficient in using LLMs in your every day work, including building scripting logic and working with large datasets with LLM assistance
- ensure high-quality AI Trainer experience and strong contributor retention
Nice to have
- 1+ year in AI data operations (RLHF, annotation, model evaluation)
- STEM background or strong technical fluency
- Python & REACT working knowledge
- Experience managing distributed contributor workforces at scale
- Background in management consulting, investment banking, or high-growth startups
- HumanSignal is an equal opportunity employer.
- We celebrate diversity and are committed to creating an inclusive environment for all employees.
Compensation
- $110,000 - $140,000
- About the Role
- HumanSignal specializes in operationally complex, multimodal data collection and annotation - delivering the datasets that frontier AI research requires and remote workforce marketplaces can't.
- We own projects end-to-end, from scoping and protocol design through final delivery, running on-site and distributed expert workforces across 50+ knowledge domains, 30+ languages, and 75+ countries.
- Our work spans RLHF, evals, red-teaming, and custom multimodal data creation, all powered by Label Studio Enterprise and built on a foundation of rigorous quality workflows, ethical sourcing, and full data security.
Apply directly at HumanSignal →Create a free account for alerts like thisView HumanSignal immigration profile
This listing is sourced directly from HumanSignal's careers page and normalized into a canonical job model.