Level Home

Senior Applied AI Engineer

Austin · Senior

Sponsorship not specifiedDetected 61 days ago

TypeScriptPythonGoReactAWSGCPRESTLLMsAgentic AILangGraph

About the role

Applied AI Engineer Location: Onsite 5 days a week in Austin, TX, relocation is offered.
It's a difficult problem that requires brilliant people and tremendous effort over time.

Ship production agentic systems- Design and build agents and agentic workflows that solve a defined problem end to end. You own prompts, tools, retrieval, guardrails, observability, cost and latency budgets, and rollout.
Automate SME workflows- Identify high-leverage operational toil (review pipelines, content QA, labeling and ops loops, support triage, internal copilots) and partner with the SMEs running those workflows to define success criteria, validate outputs, and replace meaningful chunks of that work with AI systems they trust.
Own the evaluation loop and the golden datasets that anchor it- Build offline evals, LLM-as-judge with calibration, regression suites, and online metrics.
Maintain versioned, decontaminated golden datasets covering intents, difficulty, edge cases, and adversarial inputs, and continuously enrich them with real production failures and SME-validated labels.
Make AI features safe- Treat what you deliver as a regulated product.
Design for relevant compliance frameworks (e.g., COPPA, FERPA) from day one, run safety and bias evals before launch and continuously after, and build the human-in-the-loop and content-filtering controls AI features need before they reach end users.
Make AI features easier for the rest of engineering to build- Internal libraries, patterns, and playbooks so other teams can ship AI features without your direct involvement.

We care that you have built and operated agentic systems in production, not which framework.
Senior or staff-level software engineering foundation (formal or autodidact), with several years of production environment experience and a track record of leading systems to launch.
You can decide when a deterministic workflow is the right answer instead of an autonomous agent.
Working knowledge of grounding techniques that anchor generated answers in retrieved evidence (citation and quote extraction, faithfulness and refusal evals, post-hoc consistency checks).
Practical knowledge of common agentic patterns: ReAct, tool use with structured schemas, prompt chaining, routing, orchestrator-workers, evaluator-optimizer / reflection, and human-in-the-loop.
You can explain an architectural trade-off to an executive and to a junior engineer in the same week.

Direct or transferable experience with safety, privacy, and policy constraints in user-facing AI.
K-12 or other regulated-domain experience is a strong plus.
Experience with prompt-optimization frameworks (DSPy, TEXTGRAD, AdalFlow) where they paid off in production.
A public repo, package, gist, or technical write-up of meaningful AI work, or a representative project you can describe in detail under your confidentiality constraints.
Open-source contributions to AI tooling (frameworks, agents, evals, MCP servers).
One of our interview rounds is an AI-assisted coding session.
Strong Python familiarity plus one typed language for production services (TypeScript, Go, or similar).
Cloud experience (AWS or GCP) and containerized deployment.

It is not a cleanroom algorithm round.
Onsite 5 days a week in Austin, TX, relocation is offered.
Tools that fit naturally into instruction and help students stay engaged while reducing teacher workload.
For educators: Tools that fit naturally into instruction and help students stay engaged while reducing teacher workload.

Hand off what you ship- Production features leave your hands with documentation, runbooks, an eval harness, and dashboards.
Strong prompt-engineering practice: zero-shot, few-shot, and many-shot patterns; example selection and ordering; in-context learning and chain-of-thought.
Activities that help your kid catch up or get ahead, build confidence, and minimize homework battles, whether learning at school or at home.

We are committed to helping every person maximize their potential and live a life of meaning.

This listing is sourced directly from Level Home's careers page and normalized into a canonical job model.