Sciforium

Sciforium

Senior AI Serving Engineer, Backend

San Francisco · Senior

Sponsorship not specifiedDetected 250 days ago
PythonGoRustC++Full-Stack DevelopmentKubernetesMachine LearningLLMsMLOpsSystems EngineeringCommunicationCollaboration

About the role

  • This role offers a unique opportunity to work on the core systems that power Sciforium's multimodal AI models.
  • If you enjoy low-level programming, care deeply about performance, and want exposure to the full AI stack, this role provides both high-impact work and strong growth potential.

Responsibilities

  • Build the model serving platform, including API, Control Plane, Billing, Monitoring, and distributed inference features.
  • Collaborate with ML researchers to integrate new multimodal models into production workflows.
  • Provide operational support for keeping our production services highly performant, available and reliable
  • Experience in building large scale ML/MLOps infrastructure

Requirements

  • Bachelor's degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience)
  • Strong proficiency in C++/Python/Go/Rust
  • Experience with Kubernetes, Containerization
  • You'll gain hands-on experience with performance engineering, learn how large AI models are optimized and deployed at scale, and collaborate closely with ML researchers and experienced systems engineers.
  • Ideal candidate profile

Nice to have

  • Experience with ML systems engineering, open source inference engine like vLLM, Sglang, or TRT-LLM
  • Proficiency in CUDA or ROCm and experience with GPU profiling tools
  • Contributions to open-source ML or HPC infrastructure
  • Daily lunch, snacks, and beverages

Compensation

  • Competitive salary and equity

Benefits

  • Medical, dental, and vision insurance
  • Flexible time off
  • Competitive salary and equity
  • 3+ years of software engineering experience, with a focus on infrastructure or machine learning systems.

Equal opportunity

  • Sciforium is an equal opportunity employer.
  • All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

Visa & Work Authorization

  • Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.

This listing is sourced directly from Sciforium's careers page and normalized into a canonical job model.