Anyscale
Software Engineer, ML Developer Experience
San Francisco · Senior
Stay score
odds of building a lasting career here
Thin sponsorship signal and lottery-bound. A low-probability bet with your clock running. Prioritize cap-exempt roles and proven entry-level sponsors first.
Lottery odds assume a STEM candidate.
Personalize to your clock →Employer immigration record
from this employer's Department of Labor filings
Files H-1B transfers
Sourced from Department of Labor LCA, PERM and prevailing-wage disclosure data. Employer matching is by name, so figures may be split across an employer's legal entities. Absence of a filing means none appears in our copy of the data, not that none exists.
Community outcomes
No reports yet — be the first to help the next applicant.
About the role
- Anyscale is looking for a Software Engineer to join the ML Developer Experience (MLDevX) team.
- Every user journey crosses this layer through the CLI, SDKs, APIs, UI, Workspaces, MCP, or the workflows and integrations built on top of them.
- Together, these form the user's primary interface into Anyscale, turning distributed computing from a systems problem back into a coding problem.
Responsibilities
- Manage long-running operations and make failures across jobs, tasks, actors, nodes, and GPUs easier to diagnose.
- You will work directly with users and field teams to identify high leverage problems, shape the product and technical design, and build and operate the solution.
- Build the next generation of developer tooling and MLOps capabilities on Ray, designed for both developers and coding agents.
- Develop an agent-first CLI and cohesive SDK, API, and MCP surfaces with self-discovery, structured errors, dry-run support, and consistent behavior across platform resources.
- Build the path from a trained model to a reliable production endpoint, including model registration, deployment workflows, performance benchmarking, and LLM-specific service metrics.
- Design open integrations using durable standards such as OpenAI-compatible APIs and OpenTelemetry, along with stable Jobs and Services interfaces for external orchestrators.
- A solid background in algorithms, data structures, and system design
Requirements
- We'd love to hear from you if you have
Nice to have
- Work across the Anyscale Workspaces stack to improve the path from local code to distributed execution, including environments, dependencies, images, authentication, workload submission, and debugging.
- Surface observability across the CLI, SDK, UI, and agent-facing interfaces so users can diagnose failures across jobs, tasks, actors, nodes, and GPUs.
- Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
- 5+ years of experience writing high-quality production code
- Strong product instincts and a track record of shipping developer-facing tools that people choose to use
- Experience using Ray
Skills
- Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.
Benefits
- Work closely with users and field teams to scope, ship, and iterate on the product, and collaborate with distributed systems and machine learning experts to push the boundaries of AI infrastructure.
Company info
- About Anyscale: At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels.
This listing is sourced directly from Anyscale's careers page and normalized into a canonical job model.