AI Developer Trace Task Auditor
$70 to $90/hIndicative range provided by Mercor
Posted on August 28, 2026 · Applications until October 18, 2026
I am sending you to the official Mercor page. Applying is free and in English.
I earn a commission from the platform when a candidate I referred gets hired. It changes nothing for you.
This remote role involves evaluating and grading AI-assisted software development traces for correctness and workflow quality, providing clear written feedback. Key requirements include three years of professional software development experience and hands-on work with AI coding tools.
Description in English, as published by Mercor.
Evaluate the quality and correctness of AI-assisted software-development traces used to train and evaluate a frontier AI lab's models. You'll assess end-to-end coding sessions produced with AI-assisted developer tools, judging correctness, workflow soundness, and reasoning, and provide clear, rubric-based written feedback.
Basic Qualifications • 3+ years professional software development • Hands-on experience with AI-assisted coding tools and agentic / spec-driven workflows (Cursor, GitHub Copilot, Claude Code, or similar) • Strong code-reading and debugging skills across full-stack or backend systems • Ability to evaluate multi-step coding trajectories for correctness and best practice
Preferred Qualifications • Experience with Kiro or Amazon CodeCatalyst • Prior work evaluating or grading AI-generated code • Contributions to developer tooling
3 openings
About Mercor
Mercor is a US marketplace hiring remote experts for AI and consulting projects, from law to engineering. The original posting is on their site.
View this job on MercorMore jobs in Software engineering
Python Engineering Manager, LLM Training & Evaluation
This remote freelance role involves leading large teams of Python engineers and data scientists to support foundational LLM training and evaluation workflows. Candidates must have five or more years of software engineering experience with strong Python proficiency and proven management skills.
- Python
- Software Development
Posted yesterday
Domain Expert - Engineering
This remote role involves building scalable front end features using React and JavaScript. Candidates need at least three years of experience as a front end engineer and a degree in computer science or equivalent.
- Data Engineering
Posted 2 days ago
Open Source Contributor (GitHub)
The Open Source Contributor explores, debugs, and modifies front-end and back-end components for an AI training project. Applicants need a verifiable GitHub profile with meaningful open-source contributions and strong software engineering experience across multiple programming languages.
- Python3
- JAVA
- Rust
- +3
Posted 2 days ago$100 to $150/h
Sr. Full-Stack Software Engineer
The Senior Full Stack Software Engineer builds, debugs, and evaluates front end and back end application components for an AI training project. The role requires strong professional experience developing production full stack applications and hands on expertise across multiple programming languages.
- Python
- React
- JavaScript
- +5
Posted 2 days ago$50 to $100/h