Friendliai

Software Engineer – AI Agents

San Francisco

Sponsorship not specifiedDetected 98 days ago

PythonKubernetesAPI DevelopmentMachine LearningLLMsRAGAgentic AICustomer Support

About the role

We power high-throughput, low-latency AI workloads for organizations worldwide and integrate directly with Hugging Face, giving developers instant access to over 500,000 open-source models.

Design, build, and maintain agent APIs and applications that deliver document understanding and other high-value features
Develop reference agent applications to showcase workflows and accelerate customer adoption
Collaborate with backend and infrastructure teams to integrate agents with deployment, orchestration, and monitoring systems
Ensure APIs are robust, developer-friendly, and enterprise-ready through strong design principles and documentation
In this role, you will develop not only the agent components themselves, but also the Friendli Agent API, which serves as the core developer interface for building and extending agent applications.
You will also build agent applications as production-ready examples of how agents can solve real-world problems.
FriendliAI is building the world's best AI inference platform that makes large language and multi-modal models fast, efficient, and deployable at scale.
With our world-class inference engine, we are building a platform that the AI industry can actually rely on.

3+ years of experience in software engineering, preferably in backend, ML systems, or API development
Bachelor's or Master's degree in Computer Science, Computer Engineering, or equivalent
experience with various Python frameworks
Experience designing and delivering production APIs
Familiarity with open-source LLMs and multimodal models (HuggingFace, LangChain, LlamaIndex, etc.)
The ideal candidate is comfortable creating agent applications that showcase what is possible, is curious about and experienced with open-source models, and enjoys turning them into reliable, high-impact features.
Strong programming skills in Python; experience with various Python frameworks
Solid understanding of LLM workflows, agent patterns, or tool invocation systems
Strong foundations in cloud-native development

Experience with document understanding pipelines (e.g., OCR, RAG, summarization, structured extraction)
Familiarity with Kubernetes or container orchestration in production
Built or contributed to agent frameworks, SDKs, or CLIs
Have worked in a startup or fast-paced environments with ownership and ambiguity
Passion for developer experience and enabling AI adoption

We are a small, fast-moving team doing work that matters at one of the most exciting moments in the history of technology.
We're seeking an Agent Engineer to design and build agentic features in our platform, including document understanding, advanced RAG, and customer support automation.
These applications will be primarily written in Python and will serve as reference implementations for our customers and community.
We are looking for a hands-on engineer who is passionate about building agent systems and making AI easy for developers to adopt.

This listing is sourced directly from Friendliai's careers page and normalized into a canonical job model.