Alteryx
Lead Software Development Engineer in Test
US - Remote · Contract
Stay score
odds of building a lasting career here
Sponsors, but it's cap-subject — you still face the weighted lottery (~61% per draw at Level IV). Good if you win; have a cap-exempt backup on your list.
Lottery odds assume a STEM candidate.
Personalize to your clock →Employer immigration record
from this employer's Department of Labor filings
Files H-1B transfers
Sourced from Department of Labor LCA, PERM and prevailing-wage disclosure data. Employer matching is by name, so figures may be split across an employer's legal entities. Absence of a filing means none appears in our copy of the data, not that none exists.
Community outcomes
No reports yet — be the first to help the next applicant.
About the role
- Meet the Moment with Alteryx We're living through a once-in-a-generation shift in how work gets done.
- Data, automation, and AI are quickly becoming the center of every business decision - and Alteryx is leading the transformation.
- You'll be working on the challenges that sit at the heart of modern business.
Requirements
- Experience evaluating AI agents, including multi-step task completion, tool selection, tool-call accuracy, and failure recovery.
- Working knowledge of agent frameworks, preferably LangChain, with the ability to understand and debug context handling, tool execution, and agent state.
- Hands-on experience with LangSmith or similar platforms for evaluation datasets, custom evaluators, experiments, and comparisons across agent changes.
- Experience with agent observability, using traces and telemetry to investigate quality issues, latency, token usage, and cost.
Nice to have
- modeling experience is a plus.
- Applied statistics and data analysis skills to assess variability, compare experiments, and distinguish meaningful improvements from noise
Skills
- Analyze requirements to produce a comprehensive test strategy and detailed test cases.
- Conduct performance and load testing (using tools like locust) to ensure product scalability.
Compensation
- An annual $200 home office reimbursement
Benefits
- Alteryx has amazing benefits for all Associates which can be viewed here.
- Medical, dental, and vision coverage
- Paid parental leave, caregiver leave, and flexible time off
- Mental health support and wellness reimbursement
- Career development and education assistance
- A monthly Connectivity Plus stipend of $150 to support remote work-related expenses
This listing is sourced directly from Alteryx's careers page and normalized into a canonical job model.