Freshworks
Principal Engineer
San Mateo, CA, United States · Principal
Sponsorship not specified$216k-$298kDetected 15 days ago
PythonJavaGoDistributed SystemsKubernetesPrometheusGrafanaSite Reliability EngineeringMachine LearningLLMsRAGAgentic AILangGraphIncident ResponseConfluenceSalesforceSystems EngineeringLeadershipSharePoint
About the role
- Organizations everywhere struggle under the crushing costs and complexities of "solutions" that promise to simplify their lives.
- Software is a choice that can make or break a business.
- Business software has become a blocker instead of ways to get work done.
Responsibilities
- Architect and build the core AI Agent Platform - agent runtime, orchestration, tool/API invocation, state and memory management, and the retrieval/knowledge services agents reason over
- Design for scale and efficiency: high-throughput multi-tenant serving, concurrency and queueing for agent workloads, model/inference routing, caching, and cost-aware execution
- Build the control plane and systems primitives other teams use to define, deploy, version, and operate agents safely
- Drive latency, throughput, and cost optimization across the agentic request path (planning → retrieval → tool calls → generation)
- Architect agentic operations workflows where autonomous agents observe platform telemetry, reason about anomalies, perform root-cause analysis, and execute remediation - shifting operations from human-driven to agent-driven
- Design multi-agent operational loops (detection, diagnosis, remediation) that collaborate, escalate, and hand off to on-call humans with clear rationale and audit trails
- Build closed-loop self-healing for the platform: auto-detection and repair of failing agents, degraded tools/connectors, stale knowledge, failed ingestion, and retrieval/index drift
- Drive SRE practices - capacity planning, graceful degradation, failover, chaos/resilience testing, blameless incident response - and progressively automate them through agents
- Build for operability first: every component designed to be observed, diagnosed, and acted on autonomously
- Oversee enterprise content ingestion and sync (Confluence, SharePoint, Google Drive, Salesforce KB, ServiceNow KB) and multi-modal retrieval at platform scale
Nice to have
- Strong proficiency in Python and a systems language (Go/Java)
- cloud-native architecture (Kubernetes, event-driven microservices, streaming pipelines).
- Working familiarity with RAG and knowledge systems (retrieval, embeddings, knowledge graphs) sufficient to architect over them - depth here is a plus, not the primary bar
Skills
- Define guardrails, confidence thresholds, and human-in-the-loop controls that make autonomous remediation safe at multi-tenant scale
Compensation
- $216k-$298k
Benefits
- With a fresh vision for how the world works.
Company info
- We are seeking a Sr.
Apply directly at Freshworks →Create a free account for alerts like thisView Freshworks immigration profile
This listing is sourced directly from Freshworks's careers page and normalized into a canonical job model.