athenahealth
Senior Product Manager - AI Trust & Transparency
Boston MA · Senior · Full-time
Stay score
odds of building a lasting career here
Sponsors, but it's cap-subject — you still face the weighted lottery (~61% per draw at Level IV). Good if you win; have a cap-exempt backup on your list.
Lottery odds assume a STEM candidate.
Personalize to your clock →Employer immigration record
from this employer's Department of Labor filings
Green-card follow-through: 96%
Sourced from Department of Labor LCA, PERM and prevailing-wage disclosure data. Employer matching is by name, so figures may be split across an employer's legal entities. Absence of a filing means none appears in our copy of the data, not that none exists.
Community outcomes
No reports yet — be the first to help the next applicant.
About the role
- This role is based in Boston, MA and operates in a hybrid work environment.
- This role reports to the Product Management Director within athenaClinicals.
- The team uses AI evaluation and observability platforms such as Arize and Kubeflow to assess solutions built with third-party large language models and internally developed machine learning models.
Responsibilities
- Team members partner with Product, Engineering, Design, Data Science, Patient Safety, Legal, Sales, Customer Success, and Product Marketing, while working with scrum teams in Boston and India.
- Develop evaluation strategies and safe rollout approaches for AI features, including experiments, alpha testing, beta testing, and other validation methods when appropriate.
- Develop capabilities that clearly explain how AI features work, how they were developed and evaluated, and what evidence supports their appropriate use.
- Collaborate with Sales, Customer Success, and Product Marketing to develop clear customer-facing product information and service descriptions.
- Our award-winning culture is built around shared values of inclusiveness, accountability, and support.
Requirements
- Required: At least 8 years of relevant professional experience, including 4 or more years in product management.
- Required: Practical experience with large language model evaluation methods, such as deterministic testing, model-based evaluation, human annotation workflows, and online evaluation.
Compensation
- Expected Compensation
Benefits
- Our company culture: Our talented employees - or athenistas, as we call ourselves - spark the innovation and passion needed to accomplish our vision.
- We unite as mission-driven problem-solvers with a deep desire to achieve our vision and make our time here count.
- Our DEI commitment: Our vision of accessible, high-quality, and sustainable healthcare for all requires addressing the inequities that stand in the way.
- While we know in-office collaboration is critical to our vision, we recognize that not all work needs to be done within an office environment, full-time.
- In addition to our traditional benefits and perks, we sponsor events throughout the year, including book clubs, external speakers, and hackathons.
Company info
- Define the product vision, strategy, business cases, and multi-release roadmap for AI trust, evaluation, governance, and transparency capabilities.
- Translate clinician, administrator, client, and business needs into product requirements, including standards for accuracy, bias assessment, data quality, safety, and transparency.
- Lead the end-to-end product development lifecycle, including problem definition, requirements, user experience, objectives and key results, delivery, and measurement of customer and business outcomes.
- Serve as Product Owner for assigned scrum teams by defining epics and user stories, prioritizing the backlog, and making informed trade-offs among customer value, scope, timing, and technical constraints.
- Establish and monitor performance measures that provide visibility into product outcomes, risks, and opportunities for improvement.
- Partner with Product, Engineering, Design, Data Science, Patient Safety, Legal, and business leaders to align product decisions with healthcare safety, regulatory, and operational needs.
- Integrate AI-assisted research, analysis, requirements development, prototyping, and evaluation into product workflows; assess tool limitations and outputs, apply appropriate human review, and help team members use these methods responsibly.
- Evaluate market conditions, customer needs, product dependencies, and business value to guide prioritization and product investment decisions.
- Support product teams in applying shared AI evaluation tools and governance practices to their business areas.
- Share product management and responsible AI practices with colleagues through coaching, documentation, and working sessions.
- Contribute to planning and coordination across the broader Product Management organization.
Visa & Work Authorization
- In addition to our traditional benefits and perks, we sponsor events throughout the year, including book clubs, external speakers, and hackathons
This listing is sourced directly from athenahealth's careers page and normalized into a canonical job model.