Fluency
AI Engineer
San Francisco · Exec · Full-time
Sponsorship not specified$180k-$250kDetected 67 days ago
TypeScriptPythonNode.jsAWSMachine LearningNLPLLMsResearch
About the role
- You'll evaluate them rigorously, iterate until they're production-ready, and keep improving them once they ship.
- This is an in-person role, 5 days a week in our office.
Responsibilities
- Build new AI features end to end, from prototype to production.
- Design and run evals that measure real output quality, not just first impressions.
- Iterate fast on prompts, agent designs, and orchestration patterns.
- Partner with the Product Engineer to translate requirements into AI features that actually work.
- Partner with the AI Platform team to land features on solid infrastructure.
- Hands-on experience building LLM-powered features that shipped to real users
- Practical judgment in prompt engineering, retrieval, and agent design, backed by evaluation results
- Track record of building evaluation systems that actually catch regressions
- We're hiring a full-time AI Engineer to own the prompts, agents, evals, and pipelines behind user-facing features that ship to users.
Requirements
- The ability to tell the difference between "looks good in the demo" and "works in production" is essential.
- Experience with multiple LLM providers such as Anthropic, OpenAI, Google Vertex, AWS Bedrock, or similar
- Solid software engineering fundamentals: you can write production code, not just notebooks
Nice to have
- Experience with provider-abstraction libraries for multi-LLM workflows
- Familiarity with pgvector or other vector retrieval systems
- Experience with post-training or fine-tuning
- Experience deploying AI features on AWS Lambda, ECS Fargate, or similar
- Background in ML, NLP, or applied research
- Experience with structured output, function calling, and tool use at scale
- Experience with Anyscale Ray or similar distributed compute frameworks for batch inference, eval pipelines, or scaling agent workloads
- Open source contributions in the LLM or agent tooling space
Compensation
- US$1,000 per month food and commuting allowance
- US$180,000 to US$250,000
Benefits
- We offer E-3 sponsorship for Australians to relocate with stipend.
Visa & Work Authorization
- We offer E-3 sponsorship for Australians to relocate with stipend.
Apply directly at Fluency →Create a free account for alerts like thisView Fluency immigration profile
This listing is sourced directly from Fluency's careers page and normalized into a canonical job model.