Specter
Software Engineer - ML Infrastructure
San Francisco
Sponsorship not specifiedDetected 292 days ago
PythonGoRustC++Distributed SystemsVector DatabasesMachine LearningTensorFlowPyTorchSparkData EngineeringComputer VisionLLMsAgentic AIA/B TestingSensorsResearch
About the role
- Specter is hiring an ML Infrastructure engineer to build and scale the machine learning systems that power real-time perception and inference across our edge-cloud platform.
- This role owns the data, training, deployment, and serving infrastructure for the computer vision and VLM systems that enable autonomous monitoring and orchestration across our customers' physical assets.
Responsibilities
- Developing continuous training and evaluation systems to improve model performance from production data feedback loops.
- Building tools and infrastructure for distributed training, hyperparameter optimization, and experiment tracking.
- Today, we build video sensors with state-of-the-art AI agents that answer any question, anywhere in their environments.
Requirements
- Strong software engineering fundamentals in Python, with working proficiency in a systems language (Rust, Go, C++) for performance-sensitive data and inference paths.
- Working proficiency with ML frameworks (PyTorch, TensorFlow) and model optimization tooling.
- Hands-on experience with distributed compute frameworks for ML and data workloads (Ray, Spark, or equivalent), including GPU cluster management and orchestration.
- Strong understanding of distributed systems fundamentals: partitioning, replication, backpressure, exactly-once semantics.
- Deep experience building and operating model inference systems at scale, request routing, batching, autoscaling, caching, and latency/throughput tuning under real production load.
Nice to have
- Experience with vector databases (QDrant, LanceDB, or equivalent) for similarity search and retrieval workloads.
- Familiarity with LLM/VLM serving frameworks (VLLM, SGLang, TensorRT-LLM) in production is a strong plus.
- Familiarity with video processing, sensor fusion, or multi-modal perception systems is a plus.
Benefits
- We are a small, fast growing team who hail from Anduril, Tesla, Uber, and the U.S. Special Forces.
Company info
- We offer both long range wireless (1km range) and wired sensor variants to suit any deployment.
Apply directly at Specter →Create a free account for alerts like thisView Specter immigration profile
This listing is sourced directly from Specter's careers page and normalized into a canonical job model.