Moonlite AI

Senior Software Engineer, Platform Infrastructure

Chicago, IL or Remote · Senior

Sponsorship not specified$165k-$225kDetected 62 days ago

PythonGoRustC++FastAPIDistributed SystemsPostgreSQLRedisAWSGCPAzureCloud PlatformsDockerKubernetesTerraformAnsibleLinuxPrometheusGrafanaMachine LearningCybersecurityComplianceBGP/OSPFResearch

About the role

You will be foundational to building the comprehensive infrastructure platform that bridges our physical infrastructure - bare-metal servers, GPU clusters, high-performance storage, and networking fabric - with the systems our customers depend on for large-scale computation, inference, simulations, and training.
Working closely with product, your platform team members, and infrastructure specialists, you'll design and implement the orchestration layer, APIs, and automation framework that make thousands of servers, petabytes of storage, and high-speed networks feel like a unified, programmable platform.
Job Responsibilities

Responsibilities

Design and build systems that bridge physical infrastructure (bare-metal servers, storage clusters, network fabric) with customer-facing services, enabling programmatic management of compute, networking, and storage at scale.
Design and implement systems for provisioning and managing research computing environments including Kubernetes and SLURM clusters, enabling automated deployment, resource scheduling, and workload orchestration for distributed AI training and HPC workloads.
Implement comprehensive orchestration systems that coordinate across compute, storage and networking to deliver unified experience for complex research workloads.
Design and build network provisioning automation including intelligent VM placement decisions for optimal network topology, automated VLAN and subnet configuration, and software-designed networking orchestration for high-performance interconnects.
Develop robust APIs and SDKs that enable researchers and engineering teams to programmatically provision and manage infrastructure resources across all platform domains.
Build and optimize platform services that deliver consistent high-throughput low-latency networking for demand research applications and data-intensive workloads.
Work closely with engineering, infrastructure, and product to define requirements, drive infrastructure-product-rollouts, and improve resource lifecycle management.
Implement platform-wide compliance and security features supporting SOC 2, ISO 27001, and enterprise regulatory requirements including comprehensive audit logging, access controls, and data residency management.
Self-starter who can navigate ambiguity, balance pragmatic shipping with good long-term architecture, and independently drive complex technical initiatives.
Your work will create the platform foundation that enables financial institutions to harness AI capabilities previously impossible with traditional infrastructure.

Requirements

Linux Production Experience: Strong experience with linux in production environments, including systems administration, performance tuning, and troubleshooting.
Bare-Metal & Virtualization: Deep knowledge of bare-metal infrastructure, provisioning systems, out-of-band management, and virtualization technologies (KVM, Kubernetes, etc).
Infrastructure Automation: Experience with Infrastructure-as-code tools (Terraform, Ansible) and building automated deployment pipelines.
Strong experience with linux in production environments, including systems administration, performance tuning, and troubleshooting.
Deep knowledge of bare-metal infrastructure, provisioning systems, out-of-band management, and virtualization technologies (KVM, Kubernetes, etc).
Experience with Infrastructure-as-code tools (Terraform, Ansible) and building automated deployment pipelines.

Nice to have

Go, Python, Kubernetes, Docker, Terraform, Ansible, Linux, Networking (BGP, VXLAN), Storage Systems, FastAPI, PostgreSQL, Redis, NVIDIA GPU Technologies, InfiniBand
Hands-On Ownership: As an early engineer, you'll have end-to-end ownership of projects and the autonomy to influence our product and technology direction.

Skills

Experience with systems programming languages (Go, C/C++, Rust, Python) for performance-critical components is a strong plus.
Communication
Commitment to Growth: Growth mindset with continuous focus on learning and professional development.
Background provisioning or managing research computing environments (Kubernetes, SLURM, or HPC clusters)
Experience building internal platforms, infrastructure-as-a-service, or developer tooling
Background with GPU computing platforms and AI/ML infrastructure requirements
Knowledge of high-performance networking technologies (InfiniBand, RDMA, SR-IOV)
Experience with observability and monitoring platforms (Prometheus, Grafana, ELK stack)
Familiarity with both cloud-native and bare-metal infrastructure deployment models
Understanding of enterprise compliance requirements and security best practices
Extra points for experience with financial services technology infrastructure and understanding of trading system requirements
Key Technologies

Compensation

We offer a competitive total compensation package combining a competitive base salary, startup equity, and industry-leading benefits.

Benefits

Implement comprehensive observability, telemetry, and logging systems that provide visibility into infrastructure health, performance, and utilization across the infrastructure footprint.
We offer a competitive total compensation package combining a competitive base salary, startup equity, and industry-leading benefits.
The total compensation range for this role is $165,000 - $225,000, which includes both base salary and equity.
We provide generous benefits, including a 6% 401(k) match, fully covered health insurance premiums, and other comprehensive offerings to support your well-being and success as we grow together.

Apply directly at Moonlite AI →Create a free account for alerts like this View Moonlite AI immigration profile

This listing is sourced directly from Moonlite AI's careers page and normalized into a canonical job model.