Deep Infra

Software Engineer, Early Career

Palo Alto, USA · Full-time

Sponsorship not specified$140k-$150kDetected 196 days ago

PythonC++Data StructuresAlgorithmsGitMachine LearningTensorFlowPyTorchPandasNumPyNLPLLMsControlsResearchCommunicationCollaborationProblem Solving

About the role

We believe open-source models are the future, and companies should have full control over their AI stack without being locked into proprietary providers.
This role is ideal for recent graduates or junior engineers who want to grow quickly while working on high-impact, real production AI systems.
Work on new features, fix bugs, and contribute to code reviews.

Collaborate with engineers to design, develop, and test inference solutions for state-of-the-art AI models.
Monitor and maintain production model-serving systems.
Participate in daily standups, design reviews, and team discussions.
Opportunity to learn from engineers building high-performance inference at scale.
Building AI infrastructure is complex, and we lean into that.
About DeepInfra DeepInfra is building the infrastructure layer for the next generation of AI.
We build everything from GPU infrastructure to the API layer because every millisecond matters.
Why this role matters You'll work closely with our experienced engineers to design, build, and scale infrastructure for serving top open-source AI models.
Strong fundamentals in data structures, algorithms, and software design.
Excellent problem-solving skills, with the ability to debug and optimize code.

Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related field (completed or in final year).
Proficiency in Python, including experience with AI/ML libraries and frameworks (e.g., NumPy, pandas, SciPy, TensorFlow, PyTorch).
Experience with AI/ML through coursework, research, personal projects, full-time employment, or internships.
Familiarity with AI models, Transformers and Diffusers.
Experience with version control systems (e.g., Git) and agile development methodologies.
We are looking for early-career Software Engineers (0-2 years of experience, including internships) to join our team.
Implement, optimize, and evaluate AI models using Python, C++, CUDA, and NCCL (previous exposure helpful - deep expertise not required).
What You Bring Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related field (completed or in final year).

If you're excited about AI/ML, have taken related courses or built projects, and want to learn how to ship things at scale - we'd love to meet you.

This listing is sourced directly from Deep Infra's careers page and normalized into a canonical job model.