AI Product Evaluator
$14 to $36/hIndicative range provided by micro1
Posted on October 16, 2026 · Applications until December 15, 2026
I am sending you to the official micro1 page. Applying is free and in English.
I earn a commission from the platform when a candidate I referred gets hired. It changes nothing for you.
Location: India, Japan or United Kingdom, Remote micro1 is engaging expert AI Product Evaluators to contribute directly to a customer's high-impact AI project. In this role, you'll apply your
Description in English, as published by micro1.
Role Title: AI Product Evaluator
Role Type: Contractor
Location: India, Japan or United Kingdom, Remote
micro1 is engaging expert AI Product Evaluators to contribute directly to a customer's high-impact AI project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. This operationally intensive engagement involves handling AI model and agent evaluations, often within strict timeframes and usage limit resets. The project benefits greatly from contributions of multiple specialists, each bringing a meticulous approach to instruction-following and quality assurance.
Scope of Work
- Evaluate AI models and agents according to detailed, pre-defined scenarios and guidelines.
- Execute a series of operational tasks designed to test model accuracy, reasoning, and responsiveness.
- Document findings, observations, and any anomalies in structured written reports.
- Reset usage limits and repeat evaluations as required by project protocols.
- Record findings and submit evaluation datasets on AI training platforms in line with project standards and milestones.
- Maintain a high standard of attention to detail and rigor across all evaluation tasks.
Preferred Qualifications
- Experience with AI products, AI models, or AI agent evaluation and testing.
- Demonstrated ability to follow complex instructions with precision and consistency.
- Exceptional attention to detail and operational thoroughness.
- Someone who already uses AI in daily life.
- Comfort working with repetitive or high-volume operational tasks within strict timeframes.
- Prior participation in digital product, software QA, or AI research projects is a plus.
- Detail-oriented, great at following instructions and documenting each step.
Required skills
- AI Models
- AI Agents
- Following Instructions
- Attention to Detail
About micro1
micro1 is an AI data lab that hires remote experts to train and evaluate models. The original posting is on their site.
View this job on micro1More jobs in Generalist
Usability Tester
The Usability Tester evaluates short questions and answers about government services to identify confusing or clear phrasing. Candidates must be US based and comfortable providing honest, specific feedback on everyday digital tasks.
Posted 5 days ago$20 to $30/h
Spanish-Language Consumer Reviewer
This remote role involves evaluating and improving Spanish language AI systems by reviewing sample questions and answers for natural phrasing. Candidates must be fluent in Spanish and English, and have recent personal experience with a US government service.
Posted 5 days ago$20 to $30/h
Consumer Reviewer
The contractor evaluates and provides feedback on AI-generated questions and answers regarding United States government services. Key requirements include recent personal experience with Medicare or another government service, and being based in the United States.
Posted 5 days ago$20 to $30/h
AI Agent Evaluator
The AI Agent Evaluator tests everyday automated scenarios on a smartphone, approves key steps, and scores results. Requirements include a Bachelor degree, two to three years of professional experience, and an active personal AI account.
- ChatGPT
- Muse
- AI agents
- +3
Posted 8 days ago$25 to $45/h
