People Culture Talent

People Culture Talent

Infrastructure Engineer

San Francisco, CA · Mid

H1B sponsorship availableDetected 112 days ago
GoDistributed SystemsPostgreSQLAWSGCPCloud PlatformsKubernetesTerraformMachine LearningLLMsComplianceResearch

About the role

  • Born out of UC Berkeley's SkyLab and the team behind Arena.ai http://Arena.ai, our leaderboards are the industry's gold standard for AI model evaluation - trusted by researchers, developers, and enterprises shaping the future of AI.
  • This is a founding role on the developer/enterprise team.

Responsibilities

  • Build API based products from the ground up. Design and implement a low-latency, high-reliability APIs for leaderboards, models, and arenas.
  • Build AI centered products. Integrate with our core evaluation platform, Arena data, and customer-specific benchmarks. Collaborate with the research team to turn novel ideas into full-featured products
  • They're building a company where deep expertise meets curiosity, and where the work genuinely matters.

Requirements

  • 4+ years of backend engineering experience, with meaningful time spent on distributed systems, infrastructure, or developer-facing platforms.
  • Strong proficiency in Go and/or Rust, with hands-on experience building high-throughput APIs or proxy/gateway systems.
  • Experience with LLM provider APIs (OpenAI, Anthropic, Google, etc.) and a working understanding of the challenges: streaming, token management, rate limits, model-specific quirks.
  • Comfort with ambiguity.

Nice to have

  • Background in ML infrastructure, model serving, or evaluation frameworks.
  • Familiarity with the modern AI infra stack (vLLM, LiteLLM, LangChain, etc.).
  • Their openings span more than one career level.

Compensation

  • The starting salary for this role is $200k and could range up to $350k USD, plus equity.
  • The provided salary depends on many factors, such as work experience and transferable skills, business needs and impact, and market demands.

Benefits

  • Comprehensive health, dental, vision, and additional support programs.
  • The opportunity to work on cutting-edge AI with a small, mission-driven team.

Company info

  • Arena Intelligence is redefining what "better" means in AI.
  • Built by researchers from UC Berkeley's SkyLab and backed by Felicis, Andreessen Horowitz, Kleiner Perkins, Lightspeed, and the University of California, this open evaluation platform has become the definitive source for understanding how AI models actually perform in the real world.
  • With over a million daily users and the trust of every major AI lab - including OpenAI, Google, and Anthropic - their crowdsourced benchmarks and human preference data power the decisions shaping the future of artificial intelligence.
  • Their leaderboards aren't just influential; they're the industry standard.
  • Behind the platform is a team of researchers, engineers, and builders from UC Berkeley, Google, Stanford, DeepMind, and beyond - people who seek truth, move fast, and care deeply about craftsmanship and impact.
  • We're building the API-based services for enterprise customers- We want to provide enterprises with the best of the ML products (like Arena Max) but customized to their business.
  • Ship enterprise-grade infrastructure. Build the systems enterprise customers expect: rate limiting, authentication, usage metering, cost attribution, audit logging, and SOC2 compliance
  • Build deep observability. Instrument infrastructure with distributed tracing, latency breakdowns, token-level usage tracking, and real-time dashboards so customers (and we) can see exactly what's happening.
  • What We're Looking For
  • Note: We are recruiting on behalf of our valued client.

Visa & Work Authorization

  • Visa sponsorship available.

This listing is sourced directly from People Culture Talent's careers page and normalized into a canonical job model.