Anaplan
Senior Software Development Engineer in Test - AI
North Carolina-Remote · Senior
Sponsorship not specifiedDetected 9 hours ago
JavaScriptPythonCI/CDRESTLLMsSeleniumpytestPostmanTest AutomationAPI TestingCommunicationProblem Solving
Stay score
odds of building a lasting career here
40Risky
Cap-exempt (no lottery)0
Sponsors this role90
Entry-level history0
PERM / green-card track0
Lottery odds40
Fits your clock70
Thin sponsorship signal and lottery-bound. A low-probability bet with your clock running. Prioritize cap-exempt roles and proven entry-level sponsors first.
Lottery odds assume a STEM candidate.
Personalize to your clock →Employer immigration record
from this employer's Department of Labor filings
Files H-1B transfers
4 transfer filings in the last year, covering 4 workers. Median labor-condition decision: 8 days. An employer that already files transfers is one that can take over an existing H-1B.
Sourced from Department of Labor LCA, PERM and prevailing-wage disclosure data. Employer matching is by name, so figures may be split across an employer's legal entities. Absence of a filing means none appears in our copy of the data, not that none exists.
Community outcomes
No reports yet — be the first to help the next applicant.
About the role
- Supported by operating principles of being strategy-led, values -based and disciplined in execution, you'll be inspired, connected, developed and rewarded here.
- We're pioneering a new role focused exclusively on quality assurance for GenAI/Agentic systems.
- This role requires a unique blend of QA expertise, understanding of GenAI behavior, and automation skills to ensure our AI features are reliable, accurate, and trustworthy.
Responsibilities
- Design and architect comprehensive test plans, evaluation frameworks, and quality metrics designed specifically for LLM-powered applications and agentic workflows.
- Develop robust, end-to-end automated test suites in Python across evaluations, API checks, UI checks, and performance tests.
- Create automated prompt testing systems and regression suites to proactively detect unintended changes in model behavior.
- Perform adversarial testing (red-teaming) to identify and mitigate model hallucinations, biases, or security vulnerabilities.
- Develop internal tools and testing frameworks that enable software engineering teams to seamlessly validate their own GenAI implementations.
- Own the overall quality and testing strategy for your workstream, maintaining high-fidelity test datasets ("golden examples") and defining QA best practices.
- Proven ability to design test cases and evaluation criteria for non-deterministic systems.
Requirements
- 12+ years of experience with test automation frameworks and scripting (Python, JavaScript, Selenium, Pytest).
- Experience with API testing tools (Postman, REST Assured) and backend testing.
- Strong experience with CI/CD pipelines and automated testing integration.
- We hire you for who you are, and we want you to bring your authentic self to work every day!
Benefits
- Our Commitment to Diversity, Equity, Inclusion and Belonging (DEIB)
- Build your career in a place where diversity, equity, inclusion and belonging aren't just words on paper - this is what drives our innovation, it's how we connect, and it contributes to what makes us a market leader.
Company info
- At Anaplan, we are a team of innovators focused on optimizing business decision-making through our leading AI-infused scenario planning and analysis platform so our customers can outpace their competition and the market.
- What unites Anaplanners across teams and geographies is our collective commitment to our customers' success and to our Winning Culture.
- Our customers rank among the who's who in the Fortune 50.
- DEIB improves our workforce, enhances trust with our partners and customers, and drives business success.
Equal opportunity
- Please contact us to request accommodation.
Visa & Work Authorization
- less of gender identity or expression, sexual orientation, religion, ethnicity, age, neurodiversity, disability status, citizenship, or any other aspect which makes people unique
Apply directly at Anaplan →Create a free account for alerts like thisView Anaplan immigration profile
This listing is sourced directly from Anaplan's careers page and normalized into a canonical job model.