TrueFoundry
Staff /Principal Engineer – Core Team
San Francisco · Principal
Sponsorship not specifiedDetected 2 days ago
TypeScriptPythonGoNode.jsDistributed SystemsCode ReviewKubernetesSite Reliability EngineeringMachine LearningLLMsAgentic AIAI OrchestrationProduct ManagementProduct StrategyCustomer SupportSystems EngineeringLeadershipCommunicationProblem Solving
About the role
- Act as the technical face of engineering for customer-related discussions and escalations
- Guide and unblock engineers across projects in the US region
Responsibilities
- Build and scale TrueFoundry's MCP Gateway and Agentic Gateway, enabling secure, reliable, and scalable AI agent interactions.
- Design and develop cloud-native, distributed systems that power AI agents, tool integrations, and enterprise AI workloads.
- Build core capabilities such as authentication, authorization, routing, observability, security, and multi-tenant infrastructure for the gateway platform.
- Drive architectural decisions, participate in design and code reviews, and ensure high engineering standards across the platform.
- Mentor engineers across teams, helping them build high-quality, reliable, and maintainable systems.
- Deep expertise in distributed systems, cloud-native architectures, and scalable system design
- Practical experience building or deploying ML/GenAI applications (or closely working with ML/DS teams)
Requirements
- 8+ years of strong backend/systems engineering experience at top technology companies or startups
- Strong working knowledge of Kubernetes, containerized workloads, and infrastructure engineering
- Ability to think strategically while also executing hands-on when required
Skills
- About TrueFoundry
- A way to orchestrate agents and enforce governance.
- A unified compute layer to run it all.
- That infrastructure layer is being built right now.
- The Problem We're Solving
- Companies are moving beyond simple chatbots to production agentic systems.
- These systems route between OpenAI, Anthropic, Google, and self-hosted models.
- They integrate dozens of tools via protocols like MCP.
- They orchestrate multi-agent workflows where agents coordinate with other agents.
- The infrastructure to support this doesn't exist yet.
- Intelligent routing with observability, cost policies, and fallback logic
- Centralized tool and MCP server management with security and lifecycle controls
Benefits
- Join a fast-growing Series A, Bay Area-based startup building cutting-edge AI infrastructure.
- Comprehensive health insurance for you and your family, including medical, dental, and vision coverage.
- 401(k) retirement plan.
- Build a deep, holistic understanding of the TrueFoundry platform across all components and shape the product vision and implementation.
- Collaborate closely with the CTO to shape the technical architecture, product roadmap, and long-term platform vision.
- Flexible hybrid work, 2 days a week in the office (Tuesday & Wednesday), with flexibility around the schedule.
Company info
- Work closely with enterprise customers to understand their AI infrastructure needs and translate feedback into scalable platform capabilities.
Apply directly at TrueFoundry →Create a free account for alerts like thisView TrueFoundry immigration profile
This listing is sourced directly from TrueFoundry's careers page and normalized into a canonical job model.