Freshworks

Freshworks

Staff Engineer - Machine Learning

San Mateo, CA, United States · Staff+

Sponsorship not specified$211k-$261kDetected 14 days ago
PythonJavaDistributed SystemsBackend DevelopmentCode ReviewPostgreSQLVector DatabasesAWSKubernetesTerraformTemporalKafkaOAuthMachine LearningAirflowLLMsRAGAgentic AILangGraphAI OrchestrationTest AutomationLeadershipCommunicationMentoring

About the role

  • Organizations everywhere struggle under the crushing costs and complexities of "solutions" that promise to simplify their lives.
  • Software is a choice that can make or break a business.
  • Business software has become a blocker instead of ways to get work done.

Responsibilities

  • Lead Implementation: Act as the lead engineer for agent runtime orchestration services, focusing on reasoning, planning, and tool invocation
  • API & SDK Design: Own the development of robust APIs and SDKs that enable internal and external teams to build and deploy agent workflows
  • State & Memory Management: Build and optimize stateful dialog management and memory services for multi-turn, context-aware agents
  • Agent Communication: Implement multi-agent communication (A2A) protocols and shared context systems
  • Workflow Design: Build and manage task scheduling and long-running operations using tools like Temporal or Airflow
  • Performance Optimization: Optimize LLM orchestration for performance and cost through caching, batching, and token monitoring
  • Data Pipeline Ownership: Implement and maintain RAG pipelines and integrations with vector databases (e.g., Pinecone, Weaviate, FAISS)
  • Telemetry Integration: Ensure all backend services support LangSmith-based evaluation and comprehensive observability
  • Tenant Isolation: Implement RBAC, API authentication, and multi-tenant isolation logic
  • Engineering Excellence: Set the standard for automated testing (unit, integration, load) and implement OpenTelemetry for full system visibility

Requirements

  • 6+ years of backend engineering experience
  • 1-2+ years of hands-on experience in AI/ML platform development
  • Expert Proficiency: Strong programming skills in Java and Python
  • Framework Expertise: Hands-on experience with LangChain, LangGraph, or LangSmith
  • Cloud & Data: Solid experience with AWS, Terraform, and a mix of relational (PostgreSQL) and Vector databases
  • Orchestration: Practical experience with workflow engines like Temporal or Airflow and messaging systems like Kafka
  • Hands-on experience with LangChain, LangGraph, or LangSmith
  • Solid experience with AWS, Terraform, and a mix of relational (PostgreSQL) and Vector databases
  • Practical experience with workflow engines like Temporal or Airflow and messaging systems like Kafka

Nice to have

  • Experience with AI-driven planning systems or dialog state tracking
  • Background in enterprise security (RBAC, SSO, OAuth2)
  • Experience working in a high-growth SaaS or startup environment
  • Active contributions to open-source backend or AI frameworks

Skills

  • Execute the transition to cloud-native, event-driven backend services using microservices or service mesh architectures

Compensation

  • $211k-$261k

Benefits

  • With a fresh vision for how the world works.
  • We are seeking a Machine Learning Staff Engineer to lead the development of core backend services powering our Agentic AI Platform.
Apply directly at Freshworks →Create a free account for alerts like thisView Freshworks immigration profile

This listing is sourced directly from Freshworks's careers page and normalized into a canonical job model.