Ivo Inc.

Senior Cloud/ML Ops Engineer

San Francisco · Senior

Sponsorship not specified$250k-$325kDetected 9 days ago

Distributed SystemsGitAWSGCPAzureKubernetesTerraformCI/CDSite Reliability EngineeringMachine LearningLLMsRAGMLOpsCanvaWordPress

About the role

Customers are cagey about their contracts, so each customer gets their isolated environment with containers, database, VPC, etc.
Cloud and LLM providers have "incidents." Customers still expect us to hit our SLAs.
We're looking for an Cloud/MLOps Engineer as part of Infrastructure team to:

Infrastructure Engineers build the foundation for Ivo's entire platform.
Design and operate multi-cluster / multi-region architectures with failover and disaster recovery strategies adhering to secure cluster isolation boundaries
Build internal tooling for cluster provisioning and lifecycle management, standardizing environments (dev → staging → prod)
Design strategies to isolate ML vs API workloads while optimizing for cost, performance, and reliability
Partner with SRE + ML teams to ensure SLOs are realistic and enforceable and models are deployed in production environments

Deep, hands-on experience with Kubernetes in production
Strong experience with infrastructure as code (Pulumi, Terraform, etc.)
Strong understanding of cluster architecture, scheduling, networking, storage primitives and failure modes in distributed systems
Experience managing multi-cluster or multi-region setups with Github CI/CD

Would describe yourself as being relentlessly resourceful http://www.paulgraham.com/relres.html.
You have a strong internal sense of urgency.
You have a bias towards doing things *today*, rather than tomorrow.
Experience working in a startup environment is preferred but not required.
How far along are we?
We launched in early access in 2023.
Since then, we've had an incredible response from the market and are growing rapidly.
We 6x'd in ARR in the last 12 months.

Ditching imprecise embeddings models in favor of agentic RAG
Large-scale LLM-based legal fact extraction
A legal assistant that can search large contract databases, without sacrificing accuracy
Clustering legal documents descended from the same family
Automatic deviation analysis to locate buried risk in huge contract databases
Merging contracts with their amendments to make a time series of "composite" contracts (a customer actually cried when we showed her this)
Own and evolve our Kubernetes platform across AWS/GCP/Azure

You'll be building the system that keeps the company running.
In addition to helping us run a solid, high-performance distributed system, we'd love someone who's as excited about LLMs as we are.
Implement security and compliance controls at the platform layer with RBAC, workload identity, secrets management while preserving data isolation aligned with residency requirements and auditability for enterprise customers

This listing is sourced directly from Ivo Inc.'s careers page and normalized into a canonical job model.