Radixark
Backend/Platform Engineer
Palo Alto, CA
Sponsorship not specifiedDetected 11 hours ago
PythonGoDistributed SystemsGitAWSGCPAzureCloud PlatformsKubernetesCI/CDPrometheusGrafanaDatadogPlatform EngineeringRESTgRPCMachine LearningLLMsResearch
About the role
- This role bridges high-performance inference/training systems with production-grade platform engineering.
Responsibilities
- Design and build production APIs for SGLang and Miles: REST/gRPC endpoints, client SDKs, API versioning
- Implement authentication, authorization, and rate limiting systems for multi-tenant deployments
- Build control plane infrastructure: job scheduling, resource allocation, model deployment management
- Create monitoring, logging, and observability systems for production inference and training workloads
- Design and implement billing integration, usage tracking, and quota management
- Build management dashboards and admin tools for cluster operations
- Partner with Systems Engineers to optimize end-to-end latency from API → serving layer
- Debug production issues and implement reliability improvements About RadixArk
Requirements
- Bachelor's or Master's degree in Computer Science, Engineering, or equivalent industry experience
- Strong proficiency in Python, Go, or Rust with production-quality code standards
- Experience with authentication, authorization, rate limiting, and multi-tenancy
- Familiarity with cloud platforms (AWS, GCP, Azure) and Kubernetes
- Experience with monitoring and observability tools (Prometheus, Grafana, DataDog)
Nice to have
- Understanding of ML serving infrastructure or high-throughput systems is a plus
Skills
- Ensure API reliability, performance, and security at scale
- Implement multi-tenancy isolation and security boundaries
- Create deployment automation, CI/CD pipelines, and rollback procedures
- Write comprehensive API documentation and integration guides
Compensation
- We offer competitive compensation with equity, comprehensive health benefits, and flexible work arrangements.
- Compensation is determined by location, level, and experience.
Company info
- We're on a mission to democratize frontier-level AI infrastructure by building world-class open systems for inference and training.
Equal opportunity
- RadixArk is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.
Visa & Work Authorization
- t opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more
Apply directly at Radixark →Create a free account for alerts like thisView Radixark immigration profile
This listing is sourced directly from Radixark's careers page and normalized into a canonical job model.