Radixark

Radixark

Performance Engineer

Palo Alto, CA

Sponsorship not specifiedDetected 5 hours ago
PythonC++Distributed SystemsAWSCloud PlatformsMachine LearningLLMsSystems EngineeringResearchCommunication

About the role

  • RadixArk is hiring a Performance Engineer in Palo Alto, CA - someone who can push LLM inference and training systems to the limit across real production workloads.
  • You'll work on the performance-critical path of SGLang, Miles, and the RadixArk infrastructure stack: latency, throughput, GPU utilization, memory efficiency, scheduling, batching, kernel behavior, distributed execution, and cost-per-token.
  • This is not a generic benchmarking role.

Responsibilities

  • Optimize latency, throughput, memory usage, batching, scheduling, routing, and GPU utilization
  • Build internal tooling for profiling, tracing, benchmarking, and regression detection

Requirements

  • Experience with GPU systems, distributed systems, inference serving, ML runtimes, or high-performance computing
  • Familiarity with profiling tools, performance debugging, tracing, and benchmark methodology
  • Comfort working with Python and C++
  • Ability to debug messy real-world performance issues across software, hardware, and infrastructure layers

Nice to have

  • Experience with CUDA, Triton, Pallas, ROCm, XLA, or kernel-level optimization is a strong plus
  • Prior experience with production AI infrastructure, cloud GPU environments, or open-source ML systems is a plus

Compensation

  • We offer competitive compensation with meaningful equity, comprehensive health benefits, and flexible work arrangements.
  • Compensation is determined by location, level, and experience.

Company info

  • Our customers care about real numbers: P99 latency, TTFT, tokens/sec/GPU, throughput under long-context workloads, cost-per-million tokens, RL rollout efficiency, and training-inference consistency.
  • Partner with customers and cloud partners on deep technical evaluations
  • What We're Looking For

Equal opportunity

  • RadixArk is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Visa & Work Authorization

  • t opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more
Apply directly at Radixark →Create a free account for alerts like thisView Radixark immigration profile

This listing is sourced directly from Radixark's careers page and normalized into a canonical job model.