Avathon
Senior AI Engineer
Pleasanton, California, United States · Senior · Contract
Sponsorship not specified$130k-$155kDetected 7 days ago
PythonVector DatabasesAWSGCPAzureCI/CDJenkinsMachine LearningTensorFlowPyTorchData EngineeringData ScienceNLPComputer VisionLLMsRAGMLOpsStatisticsA/B TestingForecastingSupply ChainLogisticsPerformance ManagementManual Testing
About the role
- Apply rigorous scientific methodologies to experimentation, model evaluation, and performance optimization
- Conduct prompt engineering, model alignment, evaluation, and performance benchmarking for GenAI applications
Responsibilities
- Build, fine-tune, and optimize Large Language Models (LLMs) and transformer-based architectures for real-world applications
- Develop scalable ML pipelines and production-grade systems in collaboration with Engineering teams
- Evolving culture with the opportunity to drive new ideas and technology
Requirements
- Strong experience with Generative AI frameworks and Large Language Models (e.g., transformer architectures, fine-tuning, RAG systems)
- Proficiency in Python and modern ML/AI libraries such as PyTorch, TensorFlow, Hugging Face, or equivalent ecosystems
- Candidates must be based in the Bay Area, CA and are expected to report to our Pleasanton office 5 days a week.
Nice to have
- Experience implementing Retrieval-Augmented Generation (RAG), vector databases, and embedding-based search systems
- Hands-on experience with LLM observability platforms (e.g., Langfuse, LangSmith, Arize Phoenix, Weights & Biases) for tracing, cost tracking, and quality monitoring in production
- Experience with LLM evaluation frameworks (e.g., RAGAS, DeepEval) and evaluation patterns such as LLM-as-judge and automated regression testing
- Practical experience deploying LLM applications with guardrails, prompt versioning, hallucination detection, and model drift monitoring
- Exposure to distributed training, model optimization, and scalable inference architectures
- Knowledge of MLOps practices, CI/CD for ML (Travis CI, Jenkins), and model lifecycle management
- Prior experience applying AI solutions in industrial or asset-intensive environments
- Experience working in fast-paced startup or product-driven environments
Skills
- Instrument and monitor LLM applications in production using observability tools, tracking cost, latency, quality, and drift
Compensation
- $130k - $155k salary annually.
- Pay for this position is based on a number of factors including geographic location and may vary depending on job-related knowledge, skills, and experience.
- Compensation Pay Range: $130k - $155k salary annually.
Benefits
- What are the benefits and perks at Avathon?
- Stock Option Grants
- Medical Coverage and Parental Leave Plans
- Contract and temporary roles are not eligible for the above benefits.
Company info
- Stay current with advancements in Generative AI, LLM research, and applied machine learning, incorporating relevant innovations into company solutions
- Below are some highlights we offer to our U.S. full-time employees -- we'd love to connect and share more!
Equal opportunity
- Avathon is an Equal Opportunity Employer.
- If you need a reasonable accommodation, please contact us to discuss how we can assist you.
Apply directly at Avathon →Create a free account for alerts like thisView Avathon immigration profile
This listing is sourced directly from Avathon's careers page and normalized into a canonical job model.