Pika
Software Engineer, AI Infra
Palo Alto HQ · Staff+
Sponsorship not specifiedDetected 36 days ago
PythonGoC++ExpressDistributed SystemsCode ReviewAWSGCPAzureKubernetesPlatform EngineeringMachine LearningTensorFlowLLMsAI OrchestrationCommunicationMentoring
About the role
- You will be responsible for architecting robust, distributed systems optimized for high-performance AI workloads, large-scale GPU orchestration, and low-latency, reliable API serving.
- Your work will directly impact the way users experience and interact with generative AI at scale.
Responsibilities
- Design, develop, and maintain scalable GPU infrastructure for training and serving state-of-the-art AI models
- Architect and optimize high-throughput, low-latency APIs for AI model serving and inference
- Lead the orchestration, scheduling, and efficient utilization of heterogeneous GPU resources across clusters
- Build and support robust systems for model deployment, monitoring, scaling, and reliability in production environments
- Collaborate with ML, backend, and platform engineering teams to deliver seamless AI-powered product features
- Drive technical direction, code reviews, and mentorship across the AI Infrastructure team
- Proven expertise in building and optimizing APIs for large-scale AI model serving (TensorFlow Serving, Triton, TorchServe, or similar)
- Ownership mentality and the drive to solve complex problems independently in ambiguous, high-growth environments
- A supportive and collaborative office culture-everyone builds, ships, and learns together
- At Pika, we're building the infrastructure that empowers everyone to create videos and express ideas through advanced AI.
Requirements
- Strong experience (5+ years) as a software engineer working on systems infrastructure, including hands-on work with ML serving and GPU orchestration
- Deep knowledge of distributed systems, Kubernetes (or similar orchestration frameworks), and cloud-native infrastructure (AWS/GCP/Azure)
- Familiarity with the challenges of high-throughput, scalable GPU fleet management, scheduling, and efficient model execution
- Proficiency in backend languages such as Python, Go, or C++, and experience optimizing for performance and reliability
Nice to have
- Experience with multi-modal AI model infrastructure (LLMs, generative models, video/image/speech models)
- Previous startup experience or experience leading high-impact projects through ambiguity and rapid iteration
- Experience with competitive coding or large-scale distributed computing environments
Compensation
- Competitive salary in the AI industry
Benefits
- Equity in a rapidly growing team shaping the future of AI
- Comprehensive health benefits, monthly stipends, and company retreats
- As a senior technical leader, you'll also mentor engineers, drive best practices, and set the technical vision for AI infrastructure at Pika.
Company info
- We are looking for a Staff/Lead Software Engineer, AI Infrastructure, to play a critical role in building and scaling the core infrastructure that powers Pika's AI capabilities.
- What We're Looking For
This listing is sourced directly from Pika's careers page and normalized into a canonical job model.