Handshake
Senior Software Engineer, Machine Learning Infrastructure
San Francisco, CA · Senior · Full-time
Sponsorship not specifiedDetected 11 days ago
TypeScriptPythonGoRedisBigQueryAWSGCPCloud PlatformsDockerKubernetesTerraformCI/CDMachine LearningPyTorchSparkAirflowData EngineeringData ScienceLLMsAgentic AIMLOps
About the role
- We're looking for a Senior Software Engineer to join our ML Infrastructure & Platform team.
Responsibilities
- Build and operate the shared infrastructure behind production ML and AI, including data pipelines, feature stores, training, and model serving.
- Develop and scale our LLM platform, including provider integrations, orchestration, observability, and controls for cost, latency, and reliability.
- Build evaluation infrastructure, including LLM eval harnesses, benchmarks, and quality measurement pipelines.
- Optimize inference infrastructure for open and fine-tuned models, including GPU serving, batching, and autoscaling.
- Partner with AI, Data Science, and Product teams to productionize new models and establish best practices for ML infrastructure across Handshake.
- Experience building and operating cloud infrastructure on AWS, GCP, or similar platforms.
- Hands-on experience building ML infrastructure, including model serving, training pipelines, feature stores, embeddings, or ML observability.
- Practical experience building production systems with LLMs or generative AI, including orchestration, provider APIs, observability, and performance optimization.
- Strong systems design skills, sound engineering judgment, and the ability to thrive in ambiguous, fast-moving environments.
- Experience building agentic systems, MCP integrations, tool use, memory systems, or voice AI applications.
Requirements
- Strong experience with Kubernetes, Docker, Terraform, CI/CD, and operating production services.
- Experience with modern data platforms such as BigQuery, Airflow, Spark, Beam/Dataflow, or streaming pipelines.
- Experience with Ray, Anyscale, KubeRay, Ray Serve, vLLM, Triton, PyTorch, or GPU-backed inference and training.
- Experience with Vertex AI, Bigtable, Redis, or feature platform infrastructure.
Compensation
- 💰 Financial Wellness: 401(k) match, competitive compensation, financial coaching
Benefits
- Handshake delivers benefits that help you feel supported-and thrive at work and in life.
- The below benefits are for full-time US employees.
- 🎯 Ownership: Equity in a fast-growing company
- 💰 Financial Wellness: 401(k) match, competitive compensation, financial coaching
- 🍼 Family Support: Paid parental leave, fertility benefits, parental coaching
- 💝 Wellbeing: Medical, dental, and vision, mental health support, $500 wellness stipend
- 📚 Growth: $2,000 learning stipend, ongoing development
- 🏝 Time Off: Flexible PTO, 15 holidays + 2 flex days
- Explore our mission, values, and comprehensive US benefits at joinhandshake.com/careers http://joinhandshake.com/careers.
- Partner hand-in-hand with world-class AI labs, Fortune 500 partners and the world's top educational institutions
- Build a massive, fast-growing business with billions in revenue
- 💻 Remote & Office: Internet, commuting, and free lunch/gym in our SF office
Company info
- About Handshake
- Handshake was founded on a simple belief that everyone deserves a path to a great career, regardless of where they went to school or who they know.
- Today, we power 25 million job seekers, 1 million+ employers, and 1,600 educational institutions.
- In 2025, we started Handshake AI and built the fastest-growing AI data business in history.
- We work directly with frontier AI lab researchers to create evaluations, publish benchmarks, and push the boundary of data.
- We've grown from $0 to ~$1B run rate and pay ~$60M to over 30K individuals every month.
- Team outings & referral bonuses
Apply directly at Handshake →Create a free account for alerts like thisView Handshake immigration profile
This listing is sourced directly from Handshake's careers page and normalized into a canonical job model.