Voya Services Company

Voya Services Company

Senior AI Engineer, Agentic Systems & Runtime Architecture

New York, NY · Senior · Part-time

Sponsorship not specified$160k-$174kDetected 23 days ago
PythonDistributed SystemsDatabricksAzureLLMsRAGAgentic AILLMOpsAI OrchestrationCybersecurityIncident ResponseResearchProblem SolvingCritical Thinking

About the role

  • We're looking for a hands-on Senior AI Engineer to lead the design, build, and operation of production agentic AI systems-including multi-agent research assistants that deliver cited, grounded answers via both conversational experiences and programmatic APIs.
  • You'll own "runtime architecture" decisions (orchestration/routing, retrieval strategy, model serving patterns, and runtime controls) and help evolve our capabilities toward more sophisticated agentic design: planner/supervisor orchestration, advanced retrieval + reranking, evaluation gates (AgentOps), agentic security, and end-to-end observability.

Responsibilities

  • Collaborate with business and technical stakeholders to translate real-world research and workflow needs into AI-powered solutions that are measurable, reliable, and safe in production.
  • Architect and build multi-agent workflows (planner/supervisor + specialist agents) with explicit state management and routing, and interoperability via emerging agent protocols (MCP for tool integration, A2A for agent-to-agent delegation) designed for non-deterministic behavior and real operational constraints.
  • Establish and operationalize AgentOps-style evaluation gates: treat the agent as a versioned artifact (model + prompt + tools + guardrails + eval thresholds), run statistical evaluation suites, and use staged rollout approaches to manage risk while maintaining iteration speed.
  • Implement agentic security controls for systems that ingest external content and use tools/APIs, including defenses against prompt injection and unsafe/over-broad tool execution.
  • Build production-grade observability across multi-step agent executions (traces/metrics/logs), define SLIs/SLOs for reliability and performance, and use telemetry to debug and improve probabilistic runtime behavior.
  • Own reliability outcomes: performance and cost tradeoffs (latency/throughput/cost), failure isolation, and incident response for AI-driven components.
  • Partner effectively with platform, security, and governance functions-ensuring enterprise standards are met while runtime architecture accountability stays with the team operating the production AI behavior.
  • Customer Focused: Passionate drive to delight our customers and offer unique solutions that deliver on their expectations.
  • Team Mentality: Partnering effectively to drive our culture and execute on our common goals.

Requirements

  • Experience with AgentOps / LLMOps practices, including staged rollout models and continuous monitoring for quality, drift, safety, and cost-per-task.
  • Proficiency in Python and modern AI engineering frameworks commonly used for agentic systems (e.g., graph-based orchestration patterns and RAG integration toolkits).
  • Proven experience designing and building LLM-powered applications in production, including prompt/tool orchestration and grounded response patterns.
  • Hands-on experience implementing multi-agent orchestration (planner/supervisor patterns, tool chaining, state management, and conditional routing.
  • Strong understanding of advanced retrieval for RAG: hybrid retrieval, rank fusion concepts, and reranking, with bonus points for contextual retrieval/contextual embeddings approaches.
  • Demonstrated ability to build evaluation systems for non-deterministic AI/agent behavior (rubrics/metrics, regression suites, and release gates), replacing "vibe checks" with systematic improvement loops.
  • Strong security mindset for LLM applications, including awareness of prompt injection (direct and indirect) and defense-in-depth patterns (input sanitization, structured prompts, output validation, least privilege, HITL where appropriate).
  • Experience designing and managing agent memory systems (working, long-term, episodic) and scalable prompt architectures - including version-controlled prompt libraries, hot-swap update patterns, and persona-specific prompt management across multi-agent systems.
  • Experience building production telemetry and diagnosing distributed, multi-hop workflows using tracing/metrics/logs (OpenTelemetry-style concepts are a plus).
  • Bonus: familiarity with Databricks, Azure Foundry and other cloud AI platform patterns and operational requirements for model/agent lifecycle management (versioning, promotion, rollback, policy enforcement, telemetry).
  • Bonus: experience in regulated or audit-minded environments where governance, traceability, and operational resilience matter.
  • Why Join Us

Nice to have

  • Help shape how agentic systems are governed and operated using a purpose-built AgentOps model aligned to regulated-firm needs (evaluation-driven gates, staged rollout, continuous monitoring).
  • Work with a team that treats multi-agent systems with the same discipline as distributed systems: contracts, observability, SLOs, and blast-radius control

Skills

  • Openness to new ways of thinking and acquiring new skills to retain a competitive advantage.
  • Learn more about Critical Skills
  • Equal Employment Opportunity
  • Voya Financial is an equal-opportunity employer.
  • Reasonable Accommodations
  • Voya is committed to the inclusion of all qualified individuals.
  • Misuse of Voya's name in fraud schemes

Compensation

  • Compensation Pay Disclosure:

Benefits

  • Health, dental, vision and life insurance plans
  • Voya Retirement Plan - employer paid cash balance retirement plan (4%)
  • Tuition reimbursement up to $5,250/year
  • Paid time off - including 20 days paid time off, nine paid company holidays and a flexible Diversity Celebration Day.
  • Learn more about Voya benefits (download PDF)

Company info

  • Together we fight for everyone's opportunity for a better financial future.
  • We will do this together - with customers, partners and colleagues.
  • Passionate drive to delight our customers and offer unique solutions that deliver on their expectations.
  • Partnering effectively to drive our culture and execute on our common goals.
  • At Voya, we have identified the following critical skills which are key to success in our culture:

Equal opportunity

  • Voya Financial provides equal opportunity to qualified individuals regardless of race, color, sex, national origin, citizenship status, religion, age, disability, veteran status, creed, marital status, sexual orientation, gender identity, genetic information, or any other status protected by state or local law.
  • As part of this commitment, Voya will ensure that persons with disabilities are provided reasonable accommodations.
  • If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and/or to receive other benefits and privileges of employment, please reference resources for applicants with disabilities.

Visa & Work Authorization

  • Voya Financial provides equal opportunity to qualified individuals regardless of race, color, sex, national origin, citizenship status, religion, age, disability, veteran status, creed, marital status, sexual orientation
Apply directly at Voya Services Company →Create a free account for alerts like thisView Voya Services Company immigration profile

This listing is sourced directly from Voya Services Company's careers page and normalized into a canonical job model.