Arize AI
Senior AI Product Engineer, Backend
Remote (United States) · Senior
Sponsorship not specified$125k-$225kDetected 23 days ago
TypeScriptPythonJavaGoNode.jsDistributed SystemsBackend DevelopmentAlgorithmsAWSGCPAzureKubernetesKafkaMachine LearningLLMsAgentic AIResearch
Stay score
odds of building a lasting career here
57Sponsors, lottery-bound
Cap-exempt (no lottery)0
Sponsors this role76
Entry-level history0
PERM / green-card track0
Lottery odds (Level IV)94
Fits your clock70
Sponsors, but it's cap-subject — you still face the weighted lottery (~61% per draw at Level IV). Good if you win; have a cap-exempt backup on your list.
Lottery odds assume a STEM candidate.
Personalize to your clock →Community outcomes
No reports yet — be the first to help the next applicant.
About the role
- Our product solutions range from clean APIs that magically instrument applications, interactive playgrounds for prompt engineering and agent development, or scaling up real-time evaluation infrastructure to handle millions of annotations per second.
Responsibilities
- Build high-volume and highly available analytics systems.
- Prototype, optimize, and maintain scalable backend services that power the Arize core platform.
- Develop and integrate collection tools for robust monitoring of ML and LLM pipelines.
- Research and implement cutting-edge visualization & dimensionality reduction algorithms in a distributed environment.
- Collaborate with our product, design, and directly with customer engineering teams to enhance and expand our product offerings.
- Contribute to the build our own in-house AI Agents
- Previous work building and operating highly complex SaaS platforms/systems.
Requirements
- 5+ years of experience working with high-performance backend systems.
- Strong experience writing Go, Python, TypeScript/Node, Java, or similar server programming languages.
- Knowledge of working with public clouds & container orchestration
- Experience with distributed stream processing
- Experience with OLAP systems.
- Familiarity with system observability tooling like Prometheus.
- Knowledge of working with public clouds & container orchestration - AWS, GCP, Azure, Kubernetes, etc.
- Experience with distributed stream processing - Kafka, Gazette, or similar.
Skills
- AI is rapidly transforming the world.
Compensation
- The estimated annual salary for this role is between $125,000 - $225,000, plus a competitive equity package.
Benefits
- Design and build APIs specific to our customers' Machine Learning and LLM workflows.
Company info
- While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person.
- What We're Looking For
- Regularly have chats with industry experts, researchers, and ethicists across the ecosystem to advance the use of responsible AI
Apply directly at Arize AI →Create a free account for alerts like thisView Arize AI immigration profile
This listing is sourced directly from Arize AI's careers page and normalized into a canonical job model.