ngrok Inc.

Software Engineer III/Senior, AI Gateway

San Francisco, CA · Senior · Full-time

No sponsorship$203k-$248kDetected 6 days ago

JavaGoRustC++ReactGitPostgreSQLKubernetesTerraformHelmNginxRESTKafkaLLMs

About the role

Instead of cobbling together nginx, NLBs, VPNs, model routers, and oodles of other tools, developers solve every networking problem with one gateway.
We're trusted by more than 9 million developers at companies like GitHub, Okta, HashiCorp, and Twilio.

You'll design and implement AI Gateway Traffic Policy Objects-rate limits, usage caps, and access rules specific to AI workloads.
You'll work with product and design to build AI-specific gateway primitives that feel intentional and safe, without leaking provider quirks or infrastructure details into customer workflows.

This code runs directly in the request path and must be fast, safe, and predictable.

ngrok runs entirely on AWS.
The codebase is primarily Go and TypeScript.
Our Bay Area employees commute to the office on Tuesdays and Wednesdays.
About ngrok Inc.
ngrok is an all-in-one cloud networking platform that secures, transforms, and routes traffic to services running anywhere.
Doesn't matter if they're sharing localhost or running AI workloads in production.

Tier 1 (SF, LA, Seattle, NYC): $202,500 - $247,500
Tier 2 (rest of US): $186,300 - $227,700
Tier 1 (SF, LA, Seattle, NYC): $180,000 - $220,000
Tier 2 (rest of US): $165,600 - $202,400
Job level and actual compensation will be evaluated based on factors including, but not limited to, qualifications objectively assessed during the interview process (including skills and prior relevant experience, potential impact, and scope of role), internal equity with other team members, market data, and specific work location.
We provide an attractive mix of salary and equity.
401(k) with 100% match up to 3% of your salary and 50% match up to another 2%.
Annual professional development budget for books, courses, conferences, or whatever helps you level up.

You're comfortable in a statically typed, compiled language such as Go, Rust, C++, or Java (with bonus points for Go)
Health stuff that actually matters.
Full premiums covered on base healthcare, dental, and vision for you.
Mental health and well-being support included, because taking care of your brain is as important as taking care of your teeth.
Retirement matching that doesn't suck.
Actually flexible time off.
We say "open, flexible vacation policy" and actually mean it.
Parental leave that's realistic.
Plus an annual home office/desk stipend to make your workspace not terrible.
Co-working space stipend if you want to get out of your house but aren't near our SF office.

We are obsessed with our pets, Viper sunglasses and Bufo (yes, the toad)
We have a designated Chief Emoji Officer - they are vital to our success!
We like software that's serious and culture that's not
what was allowed or blocked, which policies applied, and how usage accumulated.
When customers ask "what happened?", the gateway should already know.
You'll build and maintain systems that accurately measure AI usage-requests, tokens, and related metadata-so customers can understand how their AI systems behave and what they're consuming.

All candidates must be US-based, and legally authorized to work in the United States.
At this time, ngrok is unable to provide visa sponsorship for this position.
Applicants must be authorized to work in the United States on a permanent, ongoing basis without the need for current or future sponsorship.

This listing is sourced directly from ngrok Inc.'s careers page and normalized into a canonical job model.