Seekr
Principal Product Manager, SeekrFlow Evaluations
Austin, Texas, United States · Principal
Sponsorship not specifiedDetected 19 days ago
Machine LearningLLMsRAGProduct ManagementProduct StrategyResearchWriting
About the role
- As AI adoption accelerates across enterprises and government agencies, the ability to rigorously evaluate AI models and applications, and to trust those evaluations, has become a critical capability.
- This is a senior individual contributor role with broad scope.
- You'll work in close partnership with other product leaders, ensuring that evaluation capabilities inside SeekrFlow connect seamlessly with scoring, certification, and governance workflows across all Seekr products.
Responsibilities
- Define and own the multi-year strategy and roadmap for SeekrFlow's evaluation capabilities, covering the full spectrum of model types (base models, fine-tuned models, agents, and distilled applications) and ensuring alignment with platform and business priorities.
- Drive evaluation features from discovery and specification through delivery, launch, and iteration, working in close partnership with Engineering and Design.
- Own prioritization decisions and hold the line on quality and scope.
- Develop deep expertise in the unique evaluation requirements for each model type and application surface, translating those requirements into coherent product direction across SeekrFlow.
Requirements
- 8-12+ years of product management experience, with demonstrated ownership of complex, technically deep platform or infrastructure products
- Strong understanding of AI/ML model evaluation concepts, including benchmarking, bias and reliability testing, task-specific evaluation frameworks, and application types (base models, fine-tuned models, agents)
- Experience productizing research-driven or experimental technology areas where requirements evolved through iteration and technical discovery
- Proven ability to operate autonomously as a senior IC: setting direction, writing specifications, and driving cross-functional execution
- Working knowledge of LLMs, RAG, agents, fine-tuning, and distillation, deep enough to evaluate technical tradeoffs and shape product direction
Nice to have
- Experience with or exposure to U.S. federal government, defense, or intelligence community AI programs
Skills
- Clear communicator capable of making complex evaluation concepts legible to both technical teams and executive or customer audiences
- Reside in or willing to relocate to Austin, TX; able to work in office on a hybrid schedule
- Deep familiarity with AI/ML evaluation and benchmarking approaches across model types and use cases
- able to produce structured, precise specifications that enable high-quality engineering execution
- Technical Skills
- Understanding of how evaluation integrates with broader AI lifecycle workflows: data preparation, training, deployment, and monitoring
- Ability to define API, SDK, and UI surfaces for evaluation workflows and specify behavior across SaaS and self-hosted environments
- Comfortable reviewing and engaging with research papers, experimental results, and benchmark methodologies
- Preferred / Differentiating Qualifications
- Experience with AI governance, model risk management, trust and safety tooling, or audit-ready AI systems
- Experience designing platform surfaces such as dashboards, scoring systems, certification workflows, or real-time monitoring interfaces
- Background in high-growth startups or early-stage platform products where you helped define product practice and AI evaluations
Compensation
- Competitive Total Rewards – A role‑appropriate compensation structure that supports long‑term growth, including base salary, bonuses, or commission plans depending on role.
Benefits
- Equity Ownership - RSUs that let you share directly in Seekr's long‑term success and growth.
- Time Off That Respects Real Life - Unlimited PTO plus 14 paid company holidays to truly recharge.
- Competitive Total Rewards - A role‑appropriate compensation structure that supports long‑term growth, including base salary, bonuses, or commission plans depending on role.
- 401(k) with Company Match - Build your future with a retirement plan that includes employer matching.
- Comprehensive Health & Wellness - Medical, dental, vision, and life insurance coverage starting day one-for you and your family.
- Parental Leave - Paid parental leave to support employees as they welcome a new child through birth, adoption, or foste
- Work Your Way - A flexible hybrid work environment with offices in Reston, VA and Austin, TX.
Company info
- Seekr is a leader in explainable and trustworthy artificial intelligence designed to power mission-critical decisions in enterprises, government, and regulated industries.
- SeekrFlow™, our end-to-end AI platform, provides secure, auditable AI solutions tailored to sectors where transparency, accuracy, and compliance are paramount.
- Trusted by leading enterprises and government agencies, we partner with defense, finance, telecom, and critical infrastructure leaders to enable AI solutions that drive real-world results with unmatched transparency and control.
- We are a team of strategic thinkers and problem-solvers tackling the toughest challenges facing critical infrastructure and global enterprises through best-in-class AI models and customer deployment.
- Available across cloud, on-premises, and edge environments, SeekrFlow reduces bias, strengthens data integrity, and simplifies model oversight so organizations can rely on trusted AI decisions in high-stakes settings that impact society's most sensitive and vital systems.
- Our team operates with unwavering commitment to our core values and mission:
- We are driven by outcomes-our customers' success is what we strive for every day.
- We believe trust is earned, which is why we build explainability and transparency into the entire AI lifecycle.
- We take our responsibility to deliver secure AI seriously.
- We believe innovation drives progress-we are building the technologies that power the systems our society depends on.
- Company Benefits:
- Meaningful Mission & Impact - Work with a deeply talented, collaborative team solving some of the toughest AI challenges that matter.
- Work directly with enterprise and government customers to understand evaluation requirements, workflow gaps, and trust needs.
- Use those insights to validate direction and sharpen the roadmap.
This listing is sourced directly from Seekr's careers page and normalized into a canonical job model.