Thinking Machines Lab

Thinking Machines Lab

Software Engineer, Data Infrastructure

San Francisco

H1B sponsorship available$350k-$475kDetected 4 days ago
PythonRustExpressDistributed SystemsCloud PlatformsTerraformKafkaPyTorchSparkdbtLLMsLogisticsResearch

About the role

  • We're looking for an engineer to join us and contribute to data infrastructure.
  • You'll join a small, high-impact team responsible for architecting and scaling the core infrastructure behind distributed training pipelines, multimodal data catalogs, and intelligent processing systems that operate over petabytes of data.
  • Infrastructure is critical to us: it's the bedrock that enables every breakthrough.

Responsibilities

  • Design, build, and operate scalable, fault-tolerant infrastructure for LLM Research: distributed compute, data orchestration, and storage across modalities.
  • Develop high-throughput systems for data ingestion, processing, and transformation - including training data catalogs, deduplication, quality checks, and search.
  • Build systems for traceability, reproducibility, and robust quality control at every stage of the data lifecycle.
  • Implement and maintain monitoring and alerting to support platform reliability and performance.
  • Collaborate with research teams to unlock new features, improve data quality, and accelerate training cycles.
  • Thrive in a highly collaborative environment involving many, different cross-functional partners and subject matter experts.

Requirements

  • Bachelor's degree or equivalent experience in computer science, engineering, or similar.
  • Proficiency in at least one backend language (we use Python or Rust).
  • Comfort operating across the stack and owning projects end-to-end.

Nice to have

  • we encourage you to apply if you meet some but not all of these:
  • Have hands-on experience with Kafka, dbt, Terraform, and Airflow.
  • Have extensive experience understanding and scaling deduplication, data mining, and search.
  • Have strong knowledge of file formats and storage systems (e.g., Parquet, Delta Lake, etc.) and how they impact performance and scalability.
  • Are proactive about documentation, testing, and empowering your teammates with good tooling.

Skills

  • Thinking Machines Lab's mission is to empower humanity through advancing collaborative general intelligence.
  • it's the bedrock that enables every breakthrough.

Compensation

  • Depending on background, skills and experience, the expected annual salary range for this position is $350,000 - $475,000 USD.

Benefits

  • Thinking Machines offers generous health, dental, and vision benefits, unlimited PTO, paid parental leave, and relocation support as needed.

Visa & Work Authorization

  • While we can't guarantee success for every candidate or role, if you're the right fit, we're committed to working through the visa process together.
  • We sponsor visas.

This listing is sourced directly from Thinking Machines Lab's careers page and normalized into a canonical job model.