Nebius
Principal ML Solutions Architect - Token Factory
United States · Principal
No sponsorship$208k-$261kDetected 21 days ago
PythonFull-Stack DevelopmentGitAWSGCPAzureCloud PlatformsDockerKubernetesDevOpsMachine LearningNLPLLMsRAGMLOpsResearchLeadershipCommunicationWriting
About the role
- This position sits within Nebius Token Factory, our serverless platform for running and customizing open-source LLMs in production.
- Token Factory allows for serverless inference and fine-tuning ( LoRA, full FT, RFT ) backed by in-house optimizations like custom speculative decoding, quantization, cache-aware routing and dedicated endpoints.
- We're looking for a Principal ML Solutions Architect to act as the most senior technical authority for customers leveraging Token Factory's serverless inference and fine-tuning platforms.
Responsibilities
- Own the most complex, highest-stakes customer engagements from architecture through production across multiple modalities, driving measurable business value
- Design and implement production-ready LLM solutions using Token Factory's inference services
Requirements
- 8+ years of experience in ML/AI systems, with at least 4 years focused on LLMs and generative AI
- experience with RL -based fine-tuning
- Inference frameworks and libraries (vLLM, SGLang, TensorRT-LLM), including the ability to read, modify, and contribute to their internals
- Excellent communication skills, with the ability to clearly explain technical concepts to diverse audiences, from engineers to executives
- Expert knowledge of the LLM ecosystem: model architectures, fine-tuning approaches, and inference internals
- Hands-on experience with:
Nice to have
- Contributions or maintainership in major OSS inference/ML projects (vLLM, SGLang, TensorRT-LLM)
- Published research, conference talks, or widely-read technical writing in the LLM/serving space
- Proficiency with DevOps tooling (Docker, Kubernetes) and infrastructure-as-code
Skills
- Kubernetes (K8s), Docker, Git
- Provide deep technical expertise in prompt engineering, RAG architectures, model selection, and cost/performance trade-offs at scale
- Mentor Senior and mid-level Solutions Architects; raise the technical bar of the team through review, enablement, and knowledge sharing
- Represent Token Factory externally through talks, blog posts, and conferences
- vLLM, TensorRT-LLM, SGLang, Transformers, OpenAI/Anthropic SDKs
- AWS (SageMaker, Bedrock), GCP (Vertex AI), Azure (Azure ML)
- Running LLMs in production at scale: deploying, operating, and debugging inference workloads down to the framework level
- Strong Python programming skills
Compensation
- We offer competitive compensation and benefits packages.
- Actual compensation will be determined based on job-related factors, including experience, skills, qualifications, the level at which the candidate is hired, and geographic location, consistent with applicable law.
- Base Compensation Range
- $208,000 - $261,000 USD
- Pay Transparency
Benefits
- Career growth and learning opportunities
- Opportunity to work on impactful AI projects
- Health Insurance: 100% company-paid medical, dental, and vision coverage for employees and families.
- 401(k) Plan: Up to 4% company match with immediate vesting.
- Parental Leave: 20 weeks paid for primary caregivers, 12 weeks for secondary caregivers.
- Disability & Life Insurance: Company-paid short-term, long-term, and life insurance coverage.
- Remote Work Reimbursement: Up to $85/month for mobile and internet.
Company info
- owning ambiguous, high-impact problems end to end and influencing decisions across teams and customers
- Up to 4% company match with immediate vesting.
- Guide customers from PoC to production with a focus on performance, reliability, and cost efficiency - and define the standards by which the team does so
- Demonstrated technical leadership: owning ambiguous, high-impact problems end to end and influencing decisions across teams and customers
- Customers come to us to move from prototype to scaled production without the cost and complexity of building and tuning their own inference stack.
Equal opportunity
- Nebius is an equal opportunity employer.
- We are committed to fostering an inclusive and diverse workplace and to providing equal employment opportunities in all aspects of employment.
- Applicants must be authorized to work in the country in which they apply and will be required to provide proof of employment eligibility as a condition of hire.
- If you need accommodations during the application process, please let us know.
Visa & Work Authorization
- Applicants must be authorized to work in the country in which they apply and will be required to provide proof of employment eligibility as a condition of hire.
This listing is sourced directly from Nebius's careers page and normalized into a canonical job model.