TrustLab
Senior Backend / Systems Engineer (AI) - San Mateo, CA
San Mateo, California - USA · Senior
Sponsorship not specified$150k-$220kDetected 51 days ago
PythonJavaGoReactDjangoSnowflakeAWSKubernetesCI/CDData EngineeringLLMsA/B TestingSystems Engineering
About the role
- Your work will be critical in enabling our AI engineers, analysts, and data scientists to rapidly prototype, iterate, and deploy workflows, services and data pipelines that leverage large language models (LLMs).
Responsibilities
- Develop infrastructure that interfaces cleanly with LLMs, enabling prompt engineering, context injection, and modular evaluation workflows.
- Build tooling and platforms that enable fast iteration by AI engineers and analysts, including declarative pipelines, parameterized jobs, and reproducible experiments.
- Prioritize ease of deployment, integration, and testing, both for internal teams and external partners.
- Collaborate closely with product, data, and policy teams to translate nuanced safety needs into scalable, maintainable software systems.
- Passion for building systems that unlock velocity and experimentation for cross-functional teams.
- This is a high-impact role that blends backend engineering with thoughtful system design to accelerate product development and real-world impact of AI Systems, in particular LLMs.
Requirements
- 5+ years of experience in backend systems or infrastructure engineering.
- Experience designing scalable APIs, backend systems and data pipelines.
- Familiarity with LLM-based systems (e.g., prompt management, context formatting, batch inference, prompt-tuning workflows).
Nice to have
- Background in trust & safety, or content moderation.
- Familiarity with Django, Snowflake, React, Step functions.
- Experience with LLM-Ops and DevOps.
- This is a rare opportunity to define foundational infrastructure at a pivotal moment in AI adoption.
- Work in an environment that values engineering rigor, sound judgment, and psychological safety, with the ability to focus deeply on your craft without unnecessary bureaucracy.
- Compensation is determined based on experience, skills, and scope of impact.
Skills
- Strong software engineering skills in Python, Go, Java, or equivalent.
- Strong understanding of cloud-native infrastructure (e.g., AWS, Lambda, Kubernetes, CI/CD pipelines).
Compensation
- We offer competitive compensation, including a base salary range of $150,000–$220,000 USD, along with equity, comprehensive benefits, and a hybrid in-office work environment.
Benefits
- Design and build extensible backend systems that support flexible configurations for different customers and content types.
- We are seeking a Backend / Systems Engineer to help build a flexible, robust, and high-performance backend architecture that serves diverse use cases across customers and product lines.
Apply directly at TrustLab →Create a free account for alerts like thisView TrustLab immigration profile
This listing is sourced directly from TrustLab's careers page and normalized into a canonical job model.