iHerb

Sr. Software Engineer II - AI

United States of America - Remote / Home Office · Senior

Sponsorship not specified$187k-$235kDetected 14 days ago

PythonFull-Stack DevelopmentCode ReviewGitVector DatabasesMachine LearningLLMsRAGLLMOpsMLOpsExcelVendor ManagementTest AutomationMicrosoft Office

About the role

This includes RAG pipelines over the iHerb catalog and customer reviews, LLM-driven personalization, a conversational Wellness Agent, agentic workflow systems, and the evals and MLOps layer that makes AI features production-grade and repeatable.
Specializations within this track include: RAG and personalization, agent framework and tool use, evals and guardrails, and LLM application development for internal business functions such as marketing automation and BI agents.

Other duties and responsibilities not outlined in this document may be added as necessary or desirable, with or without notice.
Engineers here own what they ship; there is no separate ops handoff.
Software Engineer II - AI will lead the build of GenAI-powered product experiences and the shared AI platform infrastructure that powers them.
Design, build, and operate production AI features: RAG pipelines, LLM-driven recommendations, conversational agents, or agentic workflow automation.
Document AI system design decisions, evaluation results, and operational lessons in the shared knowledge base.
Own the observability of AI systems you build: latency, cost, quality drift, and error rates; participate in on-call rotation and respond to production incidents.
Production ownership: experience owning features end-to-end from spec through deployment, observability, and on-call. Engineers here own what they ship; there is no separate ops handoff.
Code quality fundamentals: strong grasp of software design principles, automated testing, code review, and CI/CD.

Generally requires a minimum of 10+ years of software engineering experience.
Ability to use judgment and reasoning skills, and determine when to escalate issues, as required, in a timely manner.
Python proficiency
Familiarity with vector databases, embedding models, or semantic search.
High degree of accuracy and attention to detail
Excellent organization skills and ability to multi-task
The physical demands described here are representative of those that must be met by a Team Member to successfully perform the essential functions of this job.
While performing the duties of this job, the Team Member is regularly required to talk and hear.
The Team Member is frequently required to sit, walk, climb stairs, use hands and fingers, bend, stoop and reach with hands and arms.
Ability to work extended hours as required

Exposure to MLOps tooling or model deployment pipelines.
Contributions to internal developer tooling, golden path standards, or SDLC process improvements.
Experience with e-commerce platforms, product catalogs, or high-traffic consumer applications.
Experience working in globally distributed teams.
Track record of documenting architectural decisions, writing RFCs, or contributing to engineering wikis.
Experience with Microsoft Office Suite (Word, Excel, PowerPoint)
Experience with Google Business Suite (Gmail, Drive, Docs, Sheets, Forms) preferred

Write LLM applications and integrations with marketing platforms, BI tools, or customer-facing product surfaces.
Use AI-driven SDLC tooling such as Claude Code as a daily practice for both AI and non-AI code.
hands-on experience shipping production code with AI-assisted development tools such as Claude Code, GitHub Copilot, or Cursor.
The bar is not awareness; it is daily use in delivering real software.
Knowledge, Skills and Abilities:

The anticipated pay scale for this position can be found below, however the pay range applicable to you may vary by geographic location based on where the job is located or where you work.
$187,000 - $235,000 USD

Earth's best-curated selection of health and wellness products, at the best possible value, delivered with the most convenient experience.
We're the world's largest eCommerce platform dedicated to vitamins, minerals, and supplements, and other health and wellness products.
Our vision is to become the #1 destination for health and wellness across the world.
With a passion for wellness and a mind for innovative solutions, iHerb team members share a vision for a healthier world that drives them each day.
Focus on the Customer · Empower Our People · Be Entrepreneurial & Pivot Quickly ·
iHerb Benefits
iHerb is on a mission to make health and wellness accessible to all.

Member is frequently required to sit, walk, climb stairs, use hands and fingers, bend, stoop and reach with hands and arms.
Reaching above shoulder heights, below the waist or lifting as required to file documents or store materials throughout the work day.
Member may occasionally lift or move office products and supplies up to 25 pounds.
Proper lifting techniques required.
Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
Embrace Diversity & Inclusion · Strive for Simplicity
Employees will also be eligible for Time Off and Paid Sick Leave pursuant to the company's policies.
From supplements to skincare to grocery items, we ship over 50,000 products, from over 1,800 brands direct to our customers in 180+ countries.
Our 5 Shared Values unite our global team:

This listing is sourced directly from iHerb's careers page and normalized into a canonical job model.