Extractable
QA Engineer (SDET) — AI, Data & Platform Quality
San Francisco, California, United States
Sponsorship not specifiedDetected 8 days ago
JavaScriptPythonDjangoAlgorithmsSQLMySQLBigQueryMachine LearningData EngineeringLLMsSEOSeleniumPlaywrightpytestTest AutomationCollaboration
> stay_score
odds of building a lasting career here
16Unrated
Cap-exempt (no lottery)0
Sponsors this role0
Entry-level history0
PERM / green-card track0
Lottery odds40
Fits your clock70
No strong sponsorship signal in the public record yet. In the full product we resolve the exact legal entity and show its filing history with a confidence score — treat as unverified until then.
Lottery odds assume a STEM candidate.
Personalize to your clock →> community_outcomes
No reports yet — be the first to help the next applicant.
About the role
- Why This Role Is Different QA at Finalytics goes well beyond clicking through a UI.
- This is a coding role, embedded in the same repo and release flow as our engineers that will report directly to the CTO.
- Our stack is Python/Django with a JavaScript personalization tag, backed by MySQL, Celery, BigQuery, and AWS.
Responsibilities
- Build headless Playwright end-to-end tests to verify how personalized content and tracking render on real client pages.
- Design evals for non-deterministic AI features - our conversational analytics assistant, AI content builders, and generative SEO - measuring correctness, grounding, and regression across prompt and model versions.
- Validate our agent/MCP interface - contract conformance, rate limiting, authorization, and safe failure.
- Validate data pipelines end-to-end - rollups, funnel/rate/financial ingestion, and BigQuery - with drift detection across environments.
- Drive the bug lifecycle - reproduce, capture with a failing test, and verify the fix.
- You won't just find bugs - you'll build the automated tests, evals, and data checks that let a small team ship trustworthy AI every sprint.
Requirements
- 3+ years in QA/SDET or test automation with a code-first approach.
Nice to have
- Testing or evaluating LLM applications - evals, prompt regression, tool-calling agents, or MCP.
- Data or analytics QA - BigQuery or ETL/rollup validation.
- Django, MySQL, or Celery experience.
- Security testing with SAST/DAST tooling.
- Financial industry, personalization, or CMS/marketing-platform experience.
- Familiarity with AWS.
- SaaS startup experience on a fast-moving, multi-tenant platform.
- Frontier work - help define what QA means for AI, agents, and data-driven personalization in finance.
Benefits
- Build automated data-health checks that flag stale rollups, incomplete coverage, and broken aggregations before they hit a client dashboard.
- Stand up quality dashboards - uptime, coverage, data-health, and eval scores.
Company info
- What We're Looking For 3+ years in QA/SDET or test automation with a code-first approach.
Apply directly at Extractable →Create a free account for alerts like thisView Extractable immigration profile
This listing is sourced directly from Extractable's careers page and normalized into a canonical job model.