AI Developer Trace Task Auditor
70 USD a 90 USD/hIntervallo indicativo fornito da Mercor
Pubblicato il 28 agosto 2026 · Candidature fino al 15 novembre 2026
Solo: Stati Uniti
Ti mando alla pagina ufficiale di Mercor. La candidatura è gratuita e in inglese.
Ricevo una commissione dalla piattaforma quando un candidato che ho segnalato viene assunto. Per te non cambia nulla.
This remote role involves evaluating and grading AI-assisted software development traces for correctness and workflow quality, providing clear written feedback. Key requirements include three years of professional software development experience and hands-on work with AI coding tools.
Descrizione in inglese, come pubblicata da Mercor.
Evaluate the quality and correctness of AI-assisted software-development traces used to train and evaluate a frontier AI lab's models. You'll assess end-to-end coding sessions produced with AI-assisted developer tools, judging correctness, workflow soundness, and reasoning, and provide clear, rubric-based written feedback.
Basic Qualifications • 3+ years professional software development • Hands-on experience with AI-assisted coding tools and agentic / spec-driven workflows (Cursor, GitHub Copilot, Claude Code, or similar) • Strong code-reading and debugging skills across full-stack or backend systems • Ability to evaluate multi-step coding trajectories for correctness and best practice
Preferred Qualifications • Experience with Kiro or Amazon CodeCatalyst • Prior work evaluating or grading AI-generated code • Contributions to developer tooling
3 posti
Solo: Stati Uniti
Informazioni su Mercor
Mercor è un marketplace statunitense che assume esperti da remoto per progetti di IA e consulenza, dal diritto all'ingegneria. L'annuncio originale è sul loro sito.
Vedi questa posizione su MercorPosizioni simili
SWE-Bench Task Auditor
This remote role involves evaluating and auditing software-engineering benchmark tasks, reference patches, and test harnesses for AI models. Candidates need at least three years of professional software engineering experience, open-source contribution history, and strong code-review skills.
Pubblicato 48 giorni fa70 USD a 90 USD/h
AWS Serverless & Infrastructure-as-Code Task Auditor
This remote role involves evaluating AWS serverless and infrastructure-as-code tasks to train frontier AI models, requiring over three years of hands-on experience building multi-service AWS serverless applications and strong proficiency with infrastructure-as-code.
Pubblicato 48 giorni fa70 USD a 90 USD/h
ML Challenge Task Auditor
This remote role involves evaluating the quality, correctness, and methodological rigor of applied machine learning tasks to provide clear written feedback. Candidates need at least three years of hands-on applied machine learning experience and proficiency with standard frameworks like PyTorch and TensorFlow.
Pubblicato 48 giorni fa70 USD a 90 USD/h
Kubernetes Task Auditor
This remote role involves evaluating and grading Kubernetes tasks for AI model training by assessing cluster operations and troubleshooting production scenarios. The ideal candidate brings at least three years of hands-on production Kubernetes experience and deep knowledge of cluster internals and failure modes.
Pubblicato 48 giorni fa70 USD a 90 USD/h