Level AI

Senior Backend Engineer- AI Agents (Remote)

United States · Senior

Sponsorship not specifiedDetected 10 hours ago

Distributed SystemsSQLNoSQLVector DatabasesAWSGCPAzureCloud PlatformsDockerKubernetesPlatform EngineeringAPI DevelopmentRESTgRPCMachine LearningLLMsRAGAgentic AIAI OrchestrationA/B TestingCollaborationMentoring

About the role

These systems operate in real-time, high-volume enterprise environments and are central to delivering intelligent, production-grade AI experiences.
You will work at the intersection of distributed systems, cloud infrastructure, and AI-powered applications-bringing agentic AI capabilities into production at scale.
What you'll get to do at Level AI (and more as we grow together):

Responsibilities

By combining advanced AI with deep domain understanding of customer experience, Level AI empowers teams to unlock actionable insights, automate workflows, and deliver more consistent, higher-quality support across the customer journey.
Design and build scalable backend systems powering AI Agents that operate in real-time enterprise environments
Build systems for agent memory, context management, and state persistence across interactions
Design and manage event-driven, asynchronous workflows for complex agent tasks
Build and maintain robust APIs and service layers (REST / gRPC) for agent capabilities
Collaborate with Product and Solutions teams to translate real customer workflows into agentic systems
Drive best practices in observability, monitoring, safety, and guardrails for AI systems
Strong fundamentals in system design, concurrency, and performance optimization
Opportunity to build cutting-edge AI products at scale
Experience building or integrating RAG pipelines, vector databases, or retrieval systems

Requirements

5+ years of experience in backend engineering, distributed systems, or platform engineering
Experience designing systems for real-time processing, streaming, or event-driven architectures
Strong understanding of API design (REST, gRPC) and microservices architectures
Experience with databases (SQL + NoSQL) and data modeling for high-scale systems
Hands-on experience with Docker, Kubernetes, and cloud platforms (AWS/GCP/Azure)
We'll love to explore more about you if you have:

Nice to have

Experience working with LLMs, conversational AI, or AI-powered products in production
Familiarity with agent frameworks, tool calling, or multi-step reasoning systems
Exposure to evaluation systems (offline/online evals, A/B testing for AI systems)
Understanding of prompting strategies, context windows, and model behavior optimization
Experience with real-time decisioning systems or workflow orchestration engines
Competitive compensation with performance-based upside
Work with a globally distributed, high-impact team
Regular team offsites and in-person collaboration

Skills

Architect low-latency inference pipelines integrating LLMs, SLMs, and external tools/services
Enable continuous improvement loops (feedback → retraining → deployment) for AI agents in production
Contribute to architecture decisions for scaling multi-tenant, enterprise-grade AI platforms

Compensation

Competitive compensation with performance-based upside

Benefits

Flexible vacation policy
Health insurance coverage

Company info

https://www.linkedin.com/company/level-ai/
Level AI is on a mission to turn every customer interaction into a strategic advantage.
Our AI-native platform helps enterprises transform contact centers from cost centers into engines of customer intelligence, operational efficiency, and business growth.
Our platform leverages Large Language Models and Custom Small Language Models (SLMs) to power AI Agents across the entire CX journey-customer-facing agents, agent-assist, and backend automation-along with deep conversation analytics for QA, coaching, and insights.

Apply directly at Level AI →Create a free account for alerts like this View Level AI immigration profile

This listing is sourced directly from Level AI's careers page and normalized into a canonical job model.