Mercor
ML Challenge Task Auditor
- Pay
- $70–90/hr
- Type
- Hourly
- Location
- Remote
- Who can apply
- USA only
- Posted
- Aug 28, 2026
Tip: In our experience, people who apply through a referral link have a better chance of being selected, as I’m also working on Mercor.
Free to apply. Our referral link costs you nothing and doesn’t change your pay. If you’re hired, Mercor may pay us a bonus, which keeps this site free. Never pay anyone to get AI training work.
About this role
Evaluate the quality, correctness, and methodological rigor of applied machine-learning tasks used to train and evaluate a frontier AI lab's models. You'll assess experiment design, model-selection reasoning, and evaluation methodology — and provide clear, rubric-based written feedback. Basic Qualifications 3+ years hands-on applied/experimental ML (experiment design, model selection, hyperparameter tuning, evaluation methodology) Strong grasp of data-quality rigor: leakage detection, metric gaming, and train/test/CV hygiene Proficiency with standard ML frameworks (PyTorch, TensorFlow, scikit-learn, XGBoost) Ability to critique ML claims against evidence and reproduce results Preferred Qualifications Competition / benchmark experience (e.g., Kaggle) Graduate research or publication record in applied ML Prior task-grading or peer-review experience Note: this role evaluates…
