Astera Labs Inc.

Machine Learning Infrastructure Engineer

San Jose, California, United States

Sponsorship not specified$140k-$165kDetected 4 days ago

PythonAWSGCPPlatform EngineeringMachine LearningLLMsAgentic AIMLOps

About the role

This role is for someone who wants to work on the systems behind the systems: model access layers, routing, serving paths, telemetry, observability, evaluation infrastructure, and the controls needed to make fast-moving AI work reliable in practice.
This is a platform role, but not in the old sense.

Build and improve internal AI infrastructure for LLM applications, agents, retrieval systems, and model-backed engineering workflows.
Own inference deployment paths across managed and self-serve environments, including access control, monitoring, and operational reliability.
Build platform layers such as model gateways, routing, runtime integrations, telemetry, and controls for safe execution at scale.
Develop AI Ops capabilities across evaluation, release readiness, observability, incident triage, regression detection, and cost monitoring.
Build dashboards, tracing, logging, and alerting for production AI systems, including spend and usage visibility across tools and teams.
Create reusable APIs, SDKs, and platform abstractions that make AI systems easier to deploy, evaluate, govern, and operate.

1-5 years of experience in software engineering, ML infrastructure, MLOps, platform engineering, or related backend/infrastructure roles.
Experience with AWS or GCP and real production service ownership.
Familiarity with inference deployments, model APIs, gateways, serving systems, or runtime infrastructure for LLM/ML workloads.
Experience with observability, telemetry, reliability engineering, and incident response.
Ability to translate messy platform needs into scalable internal infrastructure.

ALAB) provides rack-scale AI infrastructure through purpose-built connectivity solutions.
Discover more at www.asteralabs.com.
Machine Learning Infrastructure Engineer

observability, access control, AI spend tracking, secure managed platforms, skill/tool infrastructure, and telemetry that spans requests, tools, models, and outcomes.
If you want to work on the platform layer that makes modern agentic systems possible - and do it in a setting where the downstream users are serious engineers with high expectations - this is that role.
The base pay compensation range for this role is between $140,000 - $165,000
We know that creativity and innovation happen more often when teams include diverse ideas, backgrounds, and experiences, and we actively encourage everyone with relevant experience to apply, including people of color, LGBTQ+ and non-binary people, veterans, parents, and individuals with disabilities.
What we're looking for

This listing is sourced directly from Astera Labs Inc.'s careers page and normalized into a canonical job model.