Generalintelligencecompany
Applied AI Engineer - Agent
New York
Sponsorship not specifiedDetected 295 days ago
PythonDistributed SystemsPostgreSQLRedisDatadogData EngineeringLLMsRAGAI OrchestrationA/B TestingResearch
About the role
- We're hiring an Applied AI Engineer to push the boundaries of our Cofounder agent.
- This is a hands-on role with high ownership across research-to-production: prototyping, instrumenting, evaluating, and deploying improvements that show up directly in user outcomes.
Responsibilities
- Design and implement agent improvements end-to-end: prompting strategies, tool selection, action planning, memory usage, safety/guardrails, and recovery paths
- Build robust evaluation pipelines for the agent: offline evals (golden tasks, regression suites, behavior tests), online metrics (latency, success rate, fallout modes, cost efficiency), and experimentation frameworks (A/B, canaries, guardrail thresholds)
- Partner with product and infra to define success metrics and ship fast, safe iterations
- document design decisions and runbooks
- Hands-on LLM experience: prompt engineering, function-calling, retrieval, embeddings, evaluation design
- Write clean, well-tested code; document design decisions and runbooks
- Hands-on LLM experience: prompt engineering, function-calling, retrieval, embeddings, evaluation design; you've shipped LLM features to production
- Track record building evaluation harnesses and using them to drive improvements (regression suites, task success metrics, cost/runtime tradeoffs)
- advancing agent reliability and autonomy, building evaluation pipelines, and shipping techniques that measurably improve agent performance.
- build autonomous agents that run entire businesses
Requirements
- you enjoy finding and fixing edge cases in the wild
Nice to have
- Experience with agent frameworks, tool orchestration, and memory architectures
- RAG systems in production (chunking, retrieval quality, freshness strategies)
- Observability stacks (Datadog, OpenTelemetry), and cost/latency optimization
Skills
- Excellent debugging and instrumentation skills; you enjoy finding and fixing edge cases in the wild
Compensation
- Competitive salary and meaningful equity
Benefits
- Competitive salary and meaningful equity
- Comprehensive benefits and flexible work setup
Apply directly at Generalintelligencecompany →Create a free account for alerts like thisView Generalintelligencecompany immigration profile
This listing is sourced directly from Generalintelligencecompany's careers page and normalized into a canonical job model.