Illumio

Illumio

Sr. Machine Learning Engineer

HQ - Sunnyvale (Office) · Senior · Contract

Sponsorship not specifiedDetected 36 days ago
PythonJavaDistributed SystemsVector DatabasesAWSGCPAzureCloud PlatformsKubernetesTerraformKafkaMachine LearningSparkData EngineeringLLMsRAGAgentic AIZero TrustLeadershipCommunication

About the role

  • Illumio is the leader in ransomware and breach containment, redefining how organizations contain cyberattacks and enable operational resilience.
  • Recognized as a Leader in the Forrester Wave™ for Microsegmentation, Illumio enables Zero Trust, strengthening cyber resilience for the infrastructure, systems, and organizations that keep the world running.
  • OUR TEAM'S VISION: Our Engineering team is shaping the future of cybersecurity.

Responsibilities

  • Asynchronous Systems: Architect and optimize high-throughput, event-driven systems using Apache Kafka to handle real-time data flows.
  • Data Processing at Scale: Build and maintain large-scale data pipelines using Apache Spark or Flink to provide the high-volume analytics that power our AI.
  • Agentic Systems at Scale: Design sophisticated AI Agents capable of autonomous planning, memory management, and high-reliability tool-use across distributed environments.
  • Infrastructure & Orchestration: Lead the architectural design of containerized services on Kubernetes, ensuring high availability and scalability across Cloud Infrastructure (AWS/Azure/GCP).
  • Advanced IaC: Expertise in building reusable Terraform modules and managing complex multi-region cloud deployments.
  • All official job offers from our company are extended directly by our recruitment team and will be sent through an official E-Signature document for your review and signature.
  • Build and maintain large-scale data pipelines using Apache Spark or Flink to provide the high-volume analytics that power our AI.
  • Design sophisticated AI Agents capable of autonomous planning, memory management, and high-reliability tool-use across distributed environments.

Requirements

  • Experience with LLM deployment optimization (e.g., vLLM, TensorRT-LLM) or managing proprietary model inference endpoints.
  • 5-8 years of experience in backend engineering using Java, Python, or Go.
  • Hands on experience with agentic frameworks (e.g., AutoGen, CrewAI, or custom orchestration layers), RAG, MCP, fine tuning models and prompt engineering.
  • AI Ops: Experience with LLM deployment optimization (e.g., vLLM, TensorRT-LLM) or managing proprietary model inference endpoints.

Skills

  • ONWARDS TOGETHER!
  • Deep experience in indexing strategies (HNSW vs IVF) and performance tuning for high-concurrency vector databases at scale.

Company info

  • Our Engineering team is shaping the future of cybersecurity.
  • We thrive on visionary leadership, autonomy, and ownership, fostering a culture of innovation that propels us forward in the ever-evolving cybersecurity landscape.
  • As a leader in Zero Trust Segmentation, we are redefining security for a world facing unprecedented cyber threats.
  • You'll work with a highly scalable SaaS service built using cloud-native technologies while simultaneously shipping the solution on-premises.
  • Our guiding philosophy in Engineering is to get things right through practicing disciplined engineering, focusing, not cutting corners, and of course having fun while we are at it.
  • We believe in enabling ownership at all levels of the organization and empowering teams.
  • If you thrive in this culture, come join us!
  • As a Senior Software Engineer, you will architect high-scale distributed systems that process massive data volumes to fuel our Agentic AI ecosystem.
  • You will lead the development of autonomous agents that don't just provide analytics, but take action-driving complex automation and insights for our enterprise customers.
  • Illumio believes that an environment of unique backgrounds, experiences, viewpoints, and individual contributions creates a culture of belonging, drives our future, and makes us stronger together in support of our customers and their success.
  • Upon acceptance of any offer, we will request such information as part of the onboarding process prior to or on your first day of employment, and only after completing a background check through an authorized third-party vendor.
  • Your security is important to us, and we are committed to a safe and transparent hiring experience.
Apply directly at Illumio →Create a free account for alerts like thisView Illumio immigration profile

This listing is sourced directly from Illumio's careers page and normalized into a canonical job model.