Anaplan

Anaplan

QA Automation Engineer - AI

North Carolina-Remote, United States · Senior

Sponsorship not specifiedDetected 9 hours ago
PythonCI/CDRESTMachine LearningLLMsAgentic AIpytestPostmanTest AutomationAPI TestingCommunication

Stay score

odds of building a lasting career here

40Risky
Cap-exempt (no lottery)0
Sponsors this role90
Entry-level history0
PERM / green-card track0
Lottery odds40
Fits your clock70

Thin sponsorship signal and lottery-bound. A low-probability bet with your clock running. Prioritize cap-exempt roles and proven entry-level sponsors first.

Lottery odds assume a STEM candidate.

Personalize to your clock →

Employer immigration record

from this employer's Department of Labor filings

Files H-1B transfers

4 transfer filings in the last year, covering 4 workers. Median labor-condition decision: 8 days. An employer that already files transfers is one that can take over an existing H-1B.

Sourced from Department of Labor LCA, PERM and prevailing-wage disclosure data. Employer matching is by name, so figures may be split across an employer's legal entities. Absence of a filing means none appears in our copy of the data, not that none exists.

Community outcomes

No reports yet — be the first to help the next applicant.

About the role

  • Supported by operating principles of being strategy-led, values -based and disciplined in execution, you'll be inspired, connected, developed and rewarded here.
  • We're pioneering a new role focused exclusively on quality assurance for GenAI/Agentic systems.
  • This role requires a unique blend of QA expertise, understanding of GenAI behaviour, and automation skills to ensure our AI features are reliable, accurate, and trustworthy.

Responsibilities

  • Implement testing strategies for GenAI features, including conversational AI, agentic systems, and LLM-powered workflows within your workstream.
  • Run and maintain automated test suites for prompt testing, including regression tests designed to detect unintended changes in model behaviour.
  • Support and maintain evaluation frameworks to measure GenAI performance across accuracy, relevance, safety, consistency, and latency.
  • Assist with adversarial testing to identify potential model hallucinations or biases, and support integrating production alerting systems.
  • Utilize internal tools and testing frameworks to help developers easily validate their GenAI code, and assist with user acceptance testing.

Requirements

  • Solid experience with test automation frameworks and scripting (Python, Pytest, API, and UI Testing).
  • Experience with API testing tools (Postman, REST Assured) and backend testing.
  • We hire you for who you are, and we want you to bring your authentic self to work every day!

Benefits

  • Develop and execute end-to-end automated test coverage across evaluations, APIs, UIs, and performance tests using Python.
  • Take accountability for your workstream's automated coverage, documenting testing procedures and known issues in clear, accessible formats.
  • Our Commitment to Diversity, Equity, Inclusion and Belonging (DEIB)
  • Build your career in a place where diversity, equity, inclusion and belonging aren't just words on paper - this is what drives our innovation, it's how we connect, and it contributes to what makes us a market leader.

Company info

  • At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their competition and the market.
  • What unites Anaplanners across teams and geographies is our collective commitment to our customers' success and to our Winning Culture.
  • Our customers rank among the who's who in the Fortune 50.
  • DEIB improves our workforce, enhances trust with our partners and customers, and drives business success.

Equal opportunity

  • Please contact us to request accommodation.

Visa & Work Authorization

  • less of gender identity or expression, sexual orientation, religion, ethnicity, age, neurodiversity, disability status, citizenship, or any other aspect which makes people unique

This listing is sourced directly from Anaplan's careers page and normalized into a canonical job model.