Pika
ML Engineer, Inference & Optimization
Palo Alto HQ · Senior
Sponsorship not specifiedDetected 115 days ago
Code ReviewMachine LearningDeep LearningLLMsResearchCommunicationCollaboration
Stay score
odds of building a lasting career here
37Risky
Cap-exempt (no lottery)0
Sponsors this role80
Entry-level history0
PERM / green-card track0
Lottery odds40
Fits your clock70
Thin sponsorship signal and lottery-bound. A low-probability bet with your clock running. Prioritize cap-exempt roles and proven entry-level sponsors first.
Lottery odds assume a STEM candidate.
Personalize to your clock →Community outcomes
No reports yet — be the first to help the next applicant.
About the role
- We are seeking Senior/Staff level Inference Engineers to accelerate the performance of Pika's AI-driven products.
- In this highly technical role, you will operate at the intersection of cutting-edge inference acceleration, GPU parallelism, advanced model deployment, and video generation technologies.
- Your efforts will play a foundational role in powering the next generation of Pika's video and language models.
Responsibilities
- Accelerate Inference: Lead and implement advanced inference acceleration techniques, including attention optimization and quantization for efficient model serving.
- Maximize GPU Parallelism: Engineer and optimize GPU strategies across tensor, sequence, and pipeline parallelism (TP, SP, PP) for maximal efficiency and scalability.
- Programming for Performance: Develop and optimize high-performance computing kernels and distributed workloads using CUDA and NCCL.
- Advance AI Deployment: Collaborate with research and engineering teams to bring state-of-the-art videogen and large language models into production.
- Technical Excellence: Drive rigorous code reviews, participate in technical discussions, and mentor fellow engineers on best practices in inference and GPU programming.
- able to drive shared goals across research and engineering functions.
- A supportive and collaborative office culture-we're all building and launching together
Requirements
- GPU & Parallelism: Deep knowledge of GPU programming (CUDA, NCCL) and experience with SP, TP, PP, and other forms of parallelism for distributed inference.
Nice to have
- Experience with high-throughput video or real-time streaming model deployment
- Familiarity with distributed training and optimization toolkits
- Startup or rapid prototyping experience
- We're a tight-knit, energetic team based in Palo Alto, CA, valuing efficiency, curiosity, and the ambition to make a meaningful impact on the world.
- 5+ years engineering experience, with a strong track record in inference acceleration and model deployment at scale.
- Inference Mastery:
- GPU & Parallelism:
- Deep knowledge of GPU programming (CUDA, NCCL) and experience with SP, TP, PP, and other forms of parallelism for distributed inference.
Compensation
- Competitive salary in the AI industry
Benefits
- Equity in a fast-growing startup shaping the future of AI
- Comprehensive health benefits, monthly stipends, company retreats
- Improve Training Efficiency: (Bonus) Contribute to improvements in model training speed, stability, and resource utilization as part of our deployment lifecycle.
- Inference Mastery: Proven expertise in inference optimization, including quantization, attention acceleration, and deep learning compiler stacks.
Company info
- At Pika, we're crafting a future where video creation is seamless, intuitive, and universally accessible.
- Our mission is to empower creativity by breaking down technical barriers using the transformative power of AI.
- We work from our Palo Alto office 3-5 days a week and welcome applicants who are eager to contribute onsite.
This listing is sourced directly from Pika's careers page and normalized into a canonical job model.