Docker, Inc

Docker, Inc

Senior Software Engineer, AI Gateway

San Francisco, CA or Seattle, WA · Senior · Full-time

Sponsorship not specified$161k-$261kDetected 8 days ago
GoVector DatabasesDockerKubernetesAPI DevelopmentMachine LearningLLMsRAGAgentic AIRoadmapping

Stay score

odds of building a lasting career here

59Sponsors, lottery-bound
Cap-exempt (no lottery)0
Sponsors this role80
Entry-level history0
PERM / green-card track0
Lottery odds (Level IV)94
Fits your clock70

Sponsors, but it's cap-subject — you still face the weighted lottery (~61% per draw at Level IV). Good if you win; have a cap-exempt backup on your list.

Lottery odds assume a STEM candidate.

Personalize to your clock →

Employer immigration record

from this employer's Department of Labor filings

Files H-1B transfers

5 transfer filings in the last year, covering 5 workers. Median labor-condition decision: 7 days. An employer that already files transfers is one that can take over an existing H-1B.

Sourced from Department of Labor LCA, PERM and prevailing-wage disclosure data. Employer matching is by name, so figures may be split across an employer's legal entities. Absence of a filing means none appears in our copy of the data, not that none exists.

Community outcomes

No reports yet — be the first to help the next applicant.

About the role

  • ABOUT DOCKER Docker has been one of the most loved brands in developer tooling, trusted by more than 20 million monthly users and over 20 billion container image pulls.
  • Docker is proud to be an equal opportunity employer.

Responsibilities

  • Design and implement core systems powering the AI Gateway, including the model router, MCP gateway, and control plane
  • Build infrastructure that supports dynamic model selection/routing, auto-failover, cost-based routing, and policy enforcement
  • Own critical capabilities such as secure credential storage, session summarization, caching, and rate limiting
  • Develop APIs for developers building with OpenAI-compatible interfaces and the Model Context Protocol
  • Build the underlying infrastructure to support evaluation, telemetry, replay, and backtesting for agents and LLM workflows
  • Lead architectural decisions and mentor engineers as the team scales
  • Building a unified abstraction over fundamentally different model and tool providers without leaking their differences into the developer experience
  • Flexibility that fits your life - We trust you to manage your schedule while delivering great work.
  • We are committed to building a team that reflects a broad range of backgrounds, experiences, and perspectives.
  • We believe diverse teams build better products, make better decisions, and better serve our global community.

Requirements

  • 6+ years of backend engineering experience with production-grade systems
  • Familiarity with AI/ML platforms or model serving infrastructure
  • Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience
  • Deep knowledge of distributed and highly scalable systems, cloud-native infrastructure, and API design
  • Experience building secure, high-throughput services (e.g., gateways, proxies, load balancers, policy engines)
  • Fluency in Go, and/or Rust (both preferred)
  • A strong product mindset-you're excited about building developer-facing tools
  • Ownership mentality with a bias for shipping, learning, and iterating

Nice to have

  • Prior experience with OpenAI, Anthropic, or similar LLM APIs
  • Familiarity with RAG architectures, vector databases, or agent frameworks (e.g., LangChain, AutoGPT, CrewAI)
  • Experience with policy engines (e.g., OPA), observability frameworks (e.g., OpenTelemetry), or API gateways
  • Understanding of OAuth2.1, secret management, and cloud IAM systems
  • Experience with Kubernetes, Docker, and microservices architecture
  • Work on what's next: The agent era is just beginning.
  • Help define the infrastructure stack for the next generation of software.
  • Engineering excellence: Join a world-class engineering team that values simplicity, code quality, and deep technical thinking.

Skills

  • A model and tool routing layer with built-in security and cost optimization
  • A familiar OpenAI-compatible interface and MCP server
  • Unified observability and policy enforcement
  • Auto-RAG, tool injection, session summarization, and more

Compensation

  • Compensation & Equity

Benefits

  • Time to recharge - Generous PTO, designated quarterly Whaleness Days, and a designated end-of-year Whaleness break.
  • Home office support - Set up your workspace for comfort and success.
  • Technology stipend - Equivalent to US$100 net per month to help support your work.
  • Learning & development - Annual stipend for conferences, courses, certifications, and continued learning.
  • Parental leave - 16 weeks of paid parental leave after six months of employment.
  • Equity for all full-time employees - Share in Docker's long-term success as we continue to grow.
  • Comprehensive benefits - Medical, retirement, and paid holidays vary by country.

Equal opportunity

  • equal opportunity employer.

Visa & Work Authorization

  • Docker considers visa sponsorship on a case-by-case basis based on business needs.
Apply directly at Docker, Inc →Create a free account for alerts like thisView Docker, Inc immigration profile

This listing is sourced directly from Docker, Inc's careers page and normalized into a canonical job model.