Thinking Machines Lab
Software Engineer, Data Infrastructure
San Francisco
H1B sponsorship available$350k-$475kDetected 4 days ago
PythonRustExpressDistributed SystemsCloud PlatformsTerraformKafkaPyTorchSparkdbtLLMsLogisticsResearch
About the role
- We're looking for an engineer to join us and contribute to data infrastructure.
- You'll join a small, high-impact team responsible for architecting and scaling the core infrastructure behind distributed training pipelines, multimodal data catalogs, and intelligent processing systems that operate over petabytes of data.
- Infrastructure is critical to us: it's the bedrock that enables every breakthrough.
Responsibilities
- Design, build, and operate scalable, fault-tolerant infrastructure for LLM Research: distributed compute, data orchestration, and storage across modalities.
- Develop high-throughput systems for data ingestion, processing, and transformation - including training data catalogs, deduplication, quality checks, and search.
- Build systems for traceability, reproducibility, and robust quality control at every stage of the data lifecycle.
- Implement and maintain monitoring and alerting to support platform reliability and performance.
- Collaborate with research teams to unlock new features, improve data quality, and accelerate training cycles.
- Thrive in a highly collaborative environment involving many, different cross-functional partners and subject matter experts.
Requirements
- Bachelor's degree or equivalent experience in computer science, engineering, or similar.
- Proficiency in at least one backend language (we use Python or Rust).
- Comfort operating across the stack and owning projects end-to-end.
Nice to have
- we encourage you to apply if you meet some but not all of these:
- Have hands-on experience with Kafka, dbt, Terraform, and Airflow.
- Have extensive experience understanding and scaling deduplication, data mining, and search.
- Have strong knowledge of file formats and storage systems (e.g., Parquet, Delta Lake, etc.) and how they impact performance and scalability.
- Are proactive about documentation, testing, and empowering your teammates with good tooling.
Skills
- Thinking Machines Lab's mission is to empower humanity through advancing collaborative general intelligence.
- it's the bedrock that enables every breakthrough.
Compensation
- Depending on background, skills and experience, the expected annual salary range for this position is $350,000 - $475,000 USD.
Benefits
- Thinking Machines offers generous health, dental, and vision benefits, unlimited PTO, paid parental leave, and relocation support as needed.
Visa & Work Authorization
- While we can't guarantee success for every candidate or role, if you're the right fit, we're committed to working through the visa process together.
- We sponsor visas.
Apply directly at Thinking Machines Lab →Create a free account for alerts like thisView Thinking Machines Lab immigration profile
This listing is sourced directly from Thinking Machines Lab's careers page and normalized into a canonical job model.