GRAIL
Staff Software Development Engineer - Enterprise AI Infrastructure - #4898
Menlo Park, CA · Staff+ · Contract
Sponsorship not specified$169k-$224kDetected 6 days ago
TypeScriptPythonDistributed SystemsElasticsearchVector DatabasesAWSCloud PlatformsKubernetesTerraformHelmCI/CDOAuthMachine LearningData EngineeringData ScienceLLMsRAGAgentic AIMLOpsLangGraphAI OrchestrationCybersecurityComplianceZero Trust
About the role
- GRAIL is headquartered in the bay area of California, with locations in Washington, D.C., North Carolina, and the United Kingdom.
- It is supported by leading global investors and pharmaceutical, technology, and healthcare companies.
- This position serves as a technical expert focused on AWS and Kubernetes-based (EKS) AI infrastructure, agentic development, and multi-agent orchestration operating within a regulated environment.
Responsibilities
- Lead the end-to-end design, development, deployment, and monitoring of a scalable, governed enterprise AI platform leveraging Amazon EKS and AWS native services (e.g., Bedrock, OpenSearch Serverless, KMS, VPC).
- Design and implement agentic AI workflows, specialized autonomous agents, and multi-agent systems using advanced LLM orchestration techniques and agent frameworks.
- Architect and manage secure integrations using the Model Context Protocol (MCP) to connect the AI platform with internal systems, vector databases, and third-party SaaS applications (e.g., Google Workspace, Slack).
- Build and enforce strict identity, authorization, and zero-trust token brokering flows leveraging Okta, Auth0, and custom JWT authorizers to ensure secure, least-privilege tool execution.
- Implement deterministic policy controls (e.g., Cedar policy engine) to enforce role-based access, approval gates, and human-in-the-loop checks at the API gateway level.
- Develop and maintain highly isolated, scalable containerized runtime environments (e.g., Kubernetes pods on Amazon EKS) for secure AI model execution, tool usage, and knowledge retrieval.
- Establish and maintain comprehensive audit trails and observability for all AI interactions, utilizing AWS CloudTrail and GenAI observability tools (e.g., OpenTelemetry) to track cost, latency, and tool calls.
- Collaborate with Product Management, Security, Regulatory, and business stakeholders to translate enterprise requirements into scalable, compliant AI infrastructure solutions.
- Partner with Quality, Regulatory, Privacy, Security, and Compliance functions to ensure software and AI systems operate in accordance with applicable regulatory requirements and company policies.
Requirements
- 8-12 years of relevant software development and cloud infrastructure experience with demonstrated technical leadership.
- Deep expertise in AWS cloud architecture and container orchestration, specifically with Amazon EKS, Kubernetes networking, network isolation (VPC, PrivateLink), IAM, KMS, and GenAI services (e.g., AWS Bedrock).
- Advanced proficiency in programming languages such as Python, TypeScript, or Go, and infrastructure-as-code tools (Terraform, AWS CDK).
- Experience with vector databases, RAG (Retrieval-Augmented Generation) architectures, and row-level access controls (e.g., OpenSearch, FAISS, pgvector).
- Proficiency with CI/CD pipelines, MLOps practices, Kubernetes ecosystem tools (e.g., Helm), containerization, and modern observability stacks.
- Exceptional problem-solving and analytical skills with the ability to address ambiguous, high-impact technical challenges in AI orchestration and Kubernetes scaling.
- Excellent communication skills with the ability to explain complex LLM behaviors, infrastructure architectures, and security boundaries to technical and non-technical audiences.
- Proven mentoring and coaching capabilities that elevate cloud engineering and AI talent.
- Strong understanding of AI safety, prompt injection defenses, secure tool execution, and deterministic policy enforcement.
Nice to have
- Master's or PhD preferred.
- Bachelor's degree or equivalent in Computer Science, Software Engineering, Artificial Intelligence, Cloud Computing, or related field
Compensation
- The expected, full-time, annual base pay scale for this position is $169k-224k in Menlo Park, CA and $147K-$195K in Durham NC.
This listing is sourced directly from GRAIL's careers page and normalized into a canonical job model.