ReflectionAI

ReflectionAI

Member of Technical Staff - Data Ingestion Engineer

San Francisco · Staff+

H1B sponsorship availableDetected 33 days ago
Distributed SystemsSparkLLMsResearchCommunication

About the role

  • Data is playing an increasingly crucial role at the frontier of AI innovation.
  • Many of the most meaningful advances in recent years have come not from new architectures, but from better data.
  • You'll work directly with world-class researchers to close the loop between what we collect and how it impacts model performance.

Responsibilities

  • Reflection is a research lab making intelligence open and accessible for everyone to use, customize, and build on.
  • We build open models that let anyone control their intelligence and help shape the future of AI.
  • Build and operate large-scale data ingestion systems for pre-training, including web crawling, extraction, and dataset delivery
  • Build ingestion pipelines that scale reliably across large data campaigns
  • Develop specialized crawlers for high-priority data sources
  • As a member of the Data Team, your mission is to build and operate the ingestion systems that turn the open web and other large-scale data sources into reliable, well-structured corpora for training frontier models.
  • You will own the machinery that acquires, extracts, normalizes, versions, and delivers data to our pre-training pipelines.
  • Able to collaborate tightly across functions: researchers, infra, operations, and external partners.
  • Sponsorship support: We sponsor visas to help exceptional talent join our team and support long-term immigration pathways where applicable.
  • Team building: We have regular off-sites, happy hours, and team celebrations.

Requirements

  • Familiarity with how LLMs are trained and evaluated, and an intuition for what makes data useful for training
  • You can explain system behavior.
  • Experience building web crawling, data ingestion, or large-scale data acquisition systems using Ray, Beam, Spark, or similar technologies.
  • Comfortable working with very large datasets (multi-TB to PB scale) and building systems that are observable, testable, and maintainable
  • Comfortable designing experiments and using data to guide system improvements

Skills

  • Excellent communication skills. You can explain system behavior. You consider and communicate tradeoffs clearly

Compensation

  • Salary and equity structured to recognize and retain our talent globally.
  • Health & wellness: Comprehensive medical, dental, vision, and life, with an annual wellness allowance.

Benefits

  • Top-tier compensation: Salary and equity structured to recognize and retain our talent globally.
  • Stock options: Everyone who joins and contributes to Reflection's success gets to share in the upside through stock options.
  • Health & wellness: Comprehensive medical, dental, vision, and life, with an annual wellness allowance.
  • Life & family: 22 weeks paid parental leave for all new birthing and non-birthing parents, including adoptive and surrogate journeys.
  • Vacation days: Unlimited paid time off in the U.S. and 30 days in the U.K.

Company info

  • make intelligence open and accessible to all.

Visa & Work Authorization

  • We sponsor visas to help exceptional talent join our team and support long-term immigration pathways where applicable.

This listing is sourced directly from ReflectionAI's careers page and normalized into a canonical job model.