Friendliai
Software Engineer – Platform Security
San Francisco · Contract
Sponsorship not specifiedDetected 117 days ago
Distributed SystemsAWSGCPCloud PlatformsDockerKubernetesTerraformHelmCI/CDPrometheusGrafanaDevOpsSite Reliability EngineeringPlatform EngineeringLLMsAgentic AIComplianceElectrical EngineeringProblem Solving
About the role
- About the job FriendliAI is seeking a Forward Deployed Engineer (FDE) to assist enterprises in deploying, scaling, and operating generative and agentic AI workloads on FriendliAI infrastructure.
- Our Friendli Container can be adopted directly to AWS EKS clusters using our EKS add-on product.
- This is a hands-on, customer-embedded role.
Responsibilities
- Design and implement large-scale deployment architectures for LLM and multimodal inference
- Deploy and manage containerized workloads across Kubernetes clusters
- Diagnose production issues, such as performance bottlenecks, and implement temporary fixes as needed
- Develop scripts, Helm charts, and Terraform modules that simplify repeated deployments
Requirements
- Familiarity with inference frameworks (Triton, vLLM, TensorRT, DeepSpeed-Inference)
- Familiarity with observability stacks (Prometheus, Grafana, Loki, ELK, OTEL)
- Understanding of networking security and compliance frameworks (e.g., SOC 2)
- Experience supporting on-prem or hybrid-cloud deployments
Nice to have
- Contribute field insights to shape our platform reliability, observability, and scaling strategies
- 3+ years of experience in cloud infrastructure, DevOps, or reliability engineering
- Bachelor's or Master's degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent
- Proficiency with Kubernetes, Docker, Terraform, and Helm
- Strong foundation in distributed systems, networking, and performance tuning
- Experience with GPU-based computing and generative AI model serving workloads
- Strong technical background in backend systems or AI tooling
- Experience operating workloads on AWS, GCP, or OCI
Compensation
- Competitive compensation and benefits package
Benefits
- Competitive compensation and benefits package
- Health check-up and top-tier hardware support
- Flexible working hours and a highly collaborative environment
Company info
- FriendliAI is building the next-generation AI inference platform that accelerates the deployment of large language and multimodal models with unmatched performance and efficiency.
- Our infrastructure powers high-throughput, low-latency workloads for global organizations and integrates directly with Hugging Face, providing instant access to over 510,000 open-source models.
- We are on a mission to deliver the world's best platform for AI inference.
- Collaborate with customers' DevOps teams to integrate FriendliAI's infrastructure into their CI/CD workflows
- Lead workshops, technical sessions, or webinars to help customers master infrastructure best practices
Apply directly at Friendliai →Create a free account for alerts like thisView Friendliai immigration profile
This listing is sourced directly from Friendliai's careers page and normalized into a canonical job model.