Mercor
Machine Learning Engineer — Model Evaluation & Experimentation
US · Part-time
Sponsorship not specified$0k-$0kDetected 83 days ago
PythonGitMachine LearningLLMsA/B TestingResearchCommunicationCollaboration
Stay score
odds of building a lasting career here
39Risky
Cap-exempt (no lottery)0
Sponsors this role90
Entry-level history0
PERM / green-card track0
Lottery odds (Level I)39
Fits your clock70
Thin sponsorship signal and lottery-bound (~15% per draw). A low-probability bet with your clock running. Prioritize cap-exempt roles and proven entry-level sponsors first.
Lottery odds assume a STEM candidate.
Personalize to your clock →Community outcomes
No reports yet — be the first to help the next applicant.
About the role
- Each task represents one to two days of continuous, focused effort and spans multiple technical skills: implementation, experiment setup and execution, and rigorous analysis.
- You will work in a tight feedback loop with the lab's researchers.
- This is a full-time W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading AI lab as part of their extended workforce.
Responsibilities
- Design tasks: Turn real ML research ideas - like tweaking how an RL reward is computed - into well-defined, multi-step tasks.
- Run experiments: Implement changes, run training experiments, and analyze the results to show what a correct solution looks like.
- A perfectionist mindset: high attention to detail, creativity in task design, strong written communication, and the ability to work independently through ambiguous, open-ended problems.
- Cincinnatus LLC is an enterprise staffing company that partners with leading technology companies to source and employ highly skilled professionals for contingent and contract-based opportunities.
Requirements
- 1+ years of experience in a research or research-engineering role.
- Working proficiency in Python and Git, with comfort in both scripting and notebook environments.
Nice to have
- Past experience in AI training, model evaluation, or benchmark/task authoring is preferred.
Skills
- implementation, experiment setup and execution, and rigorous analysis.
- Evaluate models: See how frontier models handle your tasks, and note where and why they fall short.
- Core Qualifications
- MSc or PhD in machine learning, computer science, or another STEM field, or equivalent practical experience in a research-heavy domain.
- Strong familiarity with large language models: their capabilities, limitations, and evaluation techniques.
Compensation
- $0k-$0k
Benefits
- Basic understanding of reinforcement learning (reward functions, policy training) is preferred.
- Explore RL ideas: Build some of your tasks around reinforcement-learning basics such as reward functions and training behavior.
- Cincinnatus serves as the employer of record for these engagements, providing W-2 employment, payroll, benefits, and compliance, while placing employees directly within client teams to work on high-impact initiatives.
- While opportunities may be discovered through Mercor's platform, employment, onboarding, payroll, and benefits for these roles are administered by Cincinnatus LLC.
Equal opportunity
- Cincinnatus is proud to be an Equal Employment Opportunity employer.
- We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic.
- Cincinnatus is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans throughout the job application process.
This listing is sourced directly from Mercor's careers page and normalized into a canonical job model.