Solstice
Member of Technical Staff (Quality Engineering)
New York City · Staff+
Stay score
odds of building a lasting career here
Sponsors, but it's cap-subject — you still face the weighted lottery (~61% per draw at Level IV). Good if you win; have a cap-exempt backup on your list.
Lottery odds assume a STEM candidate.
Personalize to your clock →H-1B wage level
the lottery is wage-weighted — each level is one more entry
$5,589 more — $165,589 — moves this role to Level III and 3 lottery entries. That figure is inside the range the employer already advertised.
Based on the DOL prevailing wage for this occupation and worksite, a base salary of $165,589 would place this position at wage Level III. That figure is within the posted range, and I'd like to target it. This role classifies under "Software Developers" for prevailing-wage purposes.
DOL prevailing wage, 2026-27 wage year · Software Developers (15-1252) · New York-Newark-Jersey City, NY-NJ. Wage level is derived by USCIS from the offered wage, occupation and worksite; the occupation shown is inferred from the job title.
Community outcomes
No reports yet — be the first to help the next applicant.
About the role
- Our platform generates regulated pharmaceutical marketing content for the brands we work with, so when the output is wrong, say an unsupported claim or a missing safety disclosure, it becomes a real compliance problem and not just a bug to file.
- What makes this hard is that the system is probabilistic.
- The same prompt can return different answers, "correct" is often a judgment call, and the exact-match assertions that traditional QA relies on don't apply.
Responsibilities
- We're hiring our first dedicated QA lead to own quality for the AI that powers Solstice.
- We need someone who can measure quality anyway and build the evals that catch regressions before a client does, so the rest of the team can keep moving quickly.
- You'll own that side too, with a solid end-to-end suite in Playwright and the hands-on manual testing that catches what automation misses.
- Build our evaluation systems. Because we can't check an output against a single correct answer, you'll design the evals that score quality instead and decide, with evidence, what is good enough to ship.
- Test the agents for the ways they actually fail. Agents drift off their goal, loop on the same tool call, pick the wrong tool, or get hijacked by a malicious instruction buried in a document we ingest. Those are the cases you'll design for.
- Relocation support
Requirements
- Comfort with evaluation methods: golden datasets, LLM-as-judge (rubric, pairwise, reference-based), and calibrating those judges against human or expert labels.
- You can explain technical risk to non-technical people, and you both give and take direct feedback.
- Hands-on experience with agent or LLM frameworks (LangChain, LangGraph) and a feel for how agentic systems break.
- Experience with eval and LLM-observability tools (LangSmith, Langfuse, Arize Phoenix, Braintrust, RAGAS, Promptfoo, OpenAI Evals, or similar).
- Comfort in a modern frontend stack (TypeScript and React) so you can write meaningful UI tests and reproduce bugs quickly.
- Backend experience with async Python services and task queues.
Skills
- Solstice is redefining how life sciences organizations commercialize their therapeutics.
- Rapid growth:
- Frontiers of technology:
- Top-tier investors:
- Building anything great requires commitment and dedication.
Compensation
- This role offers a highly competitive NYC salary in the $160,000 to $300,000 range, calibrated to reflect experience, seniority, and the level of ownership you'll take on as part of the early team.
- We benchmark against top-tier startups and established tech companies to ensure our compensation is both fair and compelling, and we maintain flexibility at the upper end of the range for exceptional candidates who can meaningfully accelerate our product and engineering roadmap.
Benefits
- Health, dental, and vision insurance
- Ground-floor equity opportunity
- Professional growth stipend
- Experience in a regulated industry such as pharma, healthcare, or finance.
Company info
- We are incorporating new, advanced frameworks into our solution to better define the possibilities of pharmaceutical marketing.
- We're looking for someone who has the fire to prove others wrong.
- Just as much of what keeps customers happy is ordinary product reliability: that the app does what it should, and that a frontend tweak or a new feature doesn't quietly break something in production.
- Your work will reach across the whole product, from the backend services to the frontend customers use every day.
Visa & Work Authorization
- Visa sponsorship (O-1, H-1B, TN) available
This listing is sourced directly from Solstice's careers page and normalized into a canonical job model.