AI Developer Trace Task Auditor
$70 to $90/hIndicative range provided by Mercor
Posted on August 28, 2026 · Applications until December 3, 2026
Only: United States
I am sending you to the official Mercor page. Applying is free and in English.
I earn a commission from the platform when a candidate I referred gets hired. It changes nothing for you.
This remote role involves evaluating and grading AI-assisted software development traces for correctness and workflow quality, providing clear written feedback. Key requirements include three years of professional software development experience and hands-on work with AI coding tools.
Description in English, as published by Mercor.
Evaluate the quality and correctness of AI-assisted software-development traces used to train and evaluate a frontier AI lab's models. You'll assess end-to-end coding sessions produced with AI-assisted developer tools, judging correctness, workflow soundness, and reasoning, and provide clear, rubric-based written feedback.
Basic Qualifications • 3+ years professional software development • Hands-on experience with AI-assisted coding tools and agentic / spec-driven workflows (Cursor, GitHub Copilot, Claude Code, or similar) • Strong code-reading and debugging skills across full-stack or backend systems • Ability to evaluate multi-step coding trajectories for correctness and best practice
Preferred Qualifications • Experience with Kiro or Amazon CodeCatalyst • Prior work evaluating or grading AI-generated code • Contributions to developer tooling
3 openings
Only: United States
About Mercor
Mercor is a US marketplace hiring remote experts for AI and consulting projects, from law to engineering. The original posting is on their site.
View this job on MercorSimilar jobs
SWE-Bench Task Auditor
This remote role involves evaluating and auditing software-engineering benchmark tasks, reference patches, and test harnesses for AI models. Candidates need at least three years of professional software engineering experience, open-source contribution history, and strong code-review skills.
Posted 66 days ago$70 to $90/h
AWS Serverless & Infrastructure-as-Code Task Auditor
This remote role involves evaluating AWS serverless and infrastructure-as-code tasks to train frontier AI models, requiring over three years of hands-on experience building multi-service AWS serverless applications and strong proficiency with infrastructure-as-code.
Posted 66 days ago$70 to $90/h
ML Challenge Task Auditor
This remote role involves evaluating the quality, correctness, and methodological rigor of applied machine learning tasks to provide clear written feedback. Candidates need at least three years of hands-on applied machine learning experience and proficiency with standard frameworks like PyTorch and TensorFlow.
Posted 66 days ago$70 to $90/h
Kubernetes Task Auditor
This remote role involves evaluating and grading Kubernetes tasks for AI model training by assessing cluster operations and troubleshooting production scenarios. The ideal candidate brings at least three years of hands-on production Kubernetes experience and deep knowledge of cluster internals and failure modes.
Posted 66 days ago$70 to $90/h