Machinify
Staff AI Engineer
US · Staff+
Sponsorship not specified$210k-$280kDetected 62 days ago
TypeScriptPythonVector DatabasesTemporalMachine LearningNLPLLMsRAGLangGraphResearch
About the role
- Machinify is a leading healthcare intelligence company with expertise across the payment continuum, delivering unmatched value, transparency, and efficiency to health plan clients across the country.
- You'll live at the seam between research and production - turning models, prompts, and retrieval into reliable systems users depend on.
- Machinify is an employment at will employer.
Responsibilities
- Design and build LLM applications: RAG pipelines, agents, tool-use systems, structured generation, multi-step workflows
- Own prompt engineering and evaluation - write evals before you write prompts, and treat both as code
- Build the unglamorous infrastructure that makes LLMs production-grade: caching, streaming, retries, fallbacks, cost controls, observability, guardrails
- Partner with product and design on UX patterns specific to AI (latency masking, streaming UIs, confidence display, human-in-the-loop)
Requirements
- 3+ years of software engineering, with at least 1 year shipping LLM-based features in production
- Deep practical knowledge of the LLM stack: prompting techniques, function calling, structured outputs, context management, embedding models, vector search
- We participate in E-Verify as required by applicable law.
Nice to have
- Experience with agent frameworks and MCP (Model Context Protocol)
- Fine-tuning experience on open-weight models, or work with inference servers like vLLM/TGI/SGLang
- Background in security, evals, or red-teaming for LLM systems
- Contributions to open-source AI tooling
- Work from anywhere in the US!
- Machinify is digital-first.
Compensation
- In accordance with applicable state laws, we do not inquire about salary history during the recruitment process.
- Competitive salary, 401(k) with company match
- The salary for this position is based on an array of factors unique to each candidate: Such as years and depth of experience, set skills, certifications, etc.
- We are hiring for different levels and the base salary can range from $210k-$280k+ based on your assessed level.
Benefits
- Top Medical/Dental/Vision offerings
- Tuition reimbursement
- Additional health and wellness benefits and perks
- Flexible and trusting environment where you'll feel empowered to do your best work
- Compensation also includes meaningful equity, healthcare, unlimited PTO, and more.
Equal opportunity
- We are proud to be an equal opportunity workplace.
- If you require a reasonable accommodation to complete any part of the application or recruitment process, please let our recruiters know.
Visa & Work Authorization
- al employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender, gender identity or expression, or veteran status
Apply directly at Machinify →Create a free account for alerts like thisView Machinify immigration profile
This listing is sourced directly from Machinify's careers page and normalized into a canonical job model.