College Board

College Board

Senior QA Automation Engineer

Remote - USA · Senior · Full-time

Sponsorship not specified$153k-$166kDetected 79 days ago
AWSCI/CDDevOpsAgentic AIAgileJestPostmanLoad TestingTest AutomationBDDLeadershipCommunicationCollaboration

Stay score

odds of building a lasting career here

88Lottery-free
Cap-exempt (no lottery)100
Sponsors year-round90
Entry-level history60
PERM / green-card track50
Fits your clock70

Files H-1B any time — no cap, no lottery. The 2026 weighted-selection rule doesn't touch it, which makes this the strongest structural path for entry-level talent. Pay is often lower, but your odds of staying are dramatically higher.

Lottery odds assume a STEM candidate.

Personalize to your clock →

Community outcomes

No reports yet — be the first to help the next applicant.

About the role

  • We're a small, close-knit team enabling AI services for specific departments within College Board, working at the intersection of Product, Engineering, and Psychometrics.
  • For this team, you will be the primary quality - focused engineer, ensuring that solutions coming out of the team are well-crafted and meet the needs of all stakeholders from both a functional and technical standpoint.
  • You will also be asked to help explore new technologies, identify opportunities that benefit Technology as a whole, and participate in AI -driven SDLC processes.

Responsibilities

  • Design and implement testing strategies, including agentic AI, to provide automated validation of quality metrics and gates within the system.
  • Maintain the highest engineering standards in collaboration with product owners, architects, and stakeholders, in support of our systems and services
  • Create appropriate mock services to ensure zero dependency, where possible, with other teams
  • Provide entry and exit points for automated services that other engineers may use to ensure their own quality before it reaches the team level.
  • Build solutions using the best practices of Agile, CI/CD, and DevOps.
  • Participate and lead peer reviews of software engineering artifacts for both design and code
  • Contribute to SDLC process design when appropriate
  • At College Board, we offer more than a paycheck- we provide a meaningful career, a supportive team, and a comprehensive package designed to help you thrive.

Requirements

  • ~ 7 + years of experience in software systems, testing, quality assurance and scripting /development
  • Working experience with quality tools, such as Cucumber, Jest, Postman, etc.
  • Familiarity with advanced testing strategies such as using test doubles (stubs, fakes, shims, mocks)
  • Experience applying AI for both development and testing purposes
  • Experience testing code and scripting within an Amazon Web Services environment (Lambda, Step Functions, S3, Dynamo, etc.)
  • Experience working in Agile methodologies
  • Ability to travel 3-5 times a year to our NYC or Reston, VA office

Compensation

  • We're a self-sustaining nonprofit that believes in fair and competitive compensation grounded in your qualifications, experience, impact, and the market.

Benefits

  • You'll have open, transparent conversations about compensation, benefits, and what it's like to work at College Board throughout your hiring process.

Company info

  • You'll help build and evolve software that supports College Board's large-scale assessment programs, ensuring accurate, reliable outcomes for the students and educators who rely on them.
  • We're currently building and evolving this capability internally, with a focus on improving efficiency, reliability, and the day-to-day experience of the students and large educator workforce involved in this process.
  • Being small means everyone has real influence:
  • you'll wear multiple hats, partner closely with Product and Psychometrics, and help shape a broader ecosystem of scoring and orchestration services as it takes shape.
  • About the Opportunity
  • As a Senior QA Automation Engineer, y ou will be helping to develop and validate critical components that will enhance learning opportunities and feedback for millions of students, while also contributing to the needs of educators.

This listing is sourced directly from College Board's careers page and normalized into a canonical job model.