Palantir

Software Engineer - Hosted Model Infrastructure

New York, NY

No sponsorship$145k-$200kDetected 48 days ago

PythonJavaRustC++Backend DevelopmentFull-Stack DevelopmentKubernetesMachine LearningSupply ChainCommunication

About the role

We are a software engineering team with expertise in enabling ML models in production.
Our customers rely on us for frontier AI capabilities running on hardware they control, often with constrained GPU resources and limited direct access.
Rising to that challenge and meeting those expectations is what Palantir's excels at.

A World-Changing Company Palantir builds the world's leading software for data-driven decisions and operations.
By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more.
You will own services end-to-end, and work across the full stack, from inference engines, GPU scheduling to deployment pipelines, observability, and integration with Palantir's platform.
The goal is to deliver new models and capabilities quickly and continuously.
High empathy for customer needs and drive to deliver reliable, easy-to-use models
4+ years of professional software engineering experience building and operating production systems

Ability to work effectively across multiple languages and layers of the stack, from backend services and ML tooling to container orchestration and deployment configuration
Curiosity about emerging AI capabilities and the ability to quickly evaluate and integrate new models and technologies as the landscape evolves
Strong coding skills with demonstrated proficiency in programming languages, such as Java, C++, Python, Rust, or similar languages.
Familiarity with the Python ML ecosystem is valuable.
Experience with containers, Kubernetes, and deploying backend services in production environments
Strong written and verbal communication skills and ability to iterate quickly with teammates, incorporating feedback and holding a high bar for quality

Strong debugging skills and motivation to trace problems from application code through containers, orchestration, and hardware
The list below details our available benefits and some of the perks that can be enjoyed as an employee of Palantir Technologies.

Further note that total compensation for this position will be determined by each individual's relevant qualifications, work experience, skills, and other factors.

Employees (and their eligible dependents) can enroll in medical, dental, and vision insurance as well as voluntary life insurance
Employees are automatically covered by Palantir's basic life, AD&D and disability insurance
Commuter benefits

air-gapped government networks, forward-deployed defense environments, edge nodes, and enterprises with strict data sovereignty requirements.
Join us if you want to solve problems at the intersection of infrastructure and machine learning that directly enable critical customers.
The Role We are a software engineering team with expertise in enabling ML models in production.
We work to continuously improve our offerings and listen to our community as we design and update them.

Active US Security clearance, or eligibility and willingness to obtain a US Security clearance is beneficial, but not necessary

This listing is sourced directly from Palantir's careers page and normalized into a canonical job model.