Evaluation Specialist/Recent Grad
$20 to $60/hIndicative range provided by micro1
Posted on October 20, 2026 · Applications until December 19, 2026
I am sending you to the official micro1 page. Applying is free and in English.
I earn a commission from the platform when a candidate I referred gets hired. It changes nothing for you.
The Evaluation Specialist develops challenging question and answer pairs, conducts in-depth research, and tests advanced AI models. Requirements include proven independent research abilities, exceptional attention to detail, and fluent English writing skills.
Description in English, as published by micro1.
Role Title: Evaluation Specialist/Recent Grad
Role Type: Contractor
Location: Remote
micro1 is engaging Evaluation Specialists/Recent Grads to contribute to a high-impact project for a customer at the frontier of artificial intelligence. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required, your domain knowledge is what matters.
Scope of Work
- Develop original, challenging question-and-answer pairs that test the limits of advanced AI models across diverse subjects.
- Conduct in-depth research, applying rigorous source triangulation to ensure each answer is accurate, comprehensive, and well-documented.
- Create multi-step questions that require synthesis and analytical reasoning, not just single-source lookups.
- Test your questions against AI models, analyze outcomes, and iterate to increase or adjust difficulty as needed.
- Document your research process, providing clear citations and logical explanations for each answer.
- Refine content based on reviewer input and maintain alignment with project guidelines and quality standards.
Preferred Qualifications
- Proven ability to conduct thorough, independent research and critically evaluate information from multiple sources.
- Exceptional attention to detail and written precision in English (fluency required, but it does not need to be your first language).
- Talent for crafting nuanced and well-structured questions that probe deep understanding.
- Strong self-direction, reliability, and accountability in remote, independent project work.
- Interest in cutting-edge AI and a passion for testing the boundaries of current model capabilities.
- Prior experience in AI training, evaluation, or content creation is a plus, but not required.
- Open to recent graduates, advanced-degree holders, and individuals from any academic or professional background with demonstrated research and writing expertise.
Compensation Structure
Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.
Start Timeline & Availability
We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24, 48 hours of completing onboarding.
Required skills
- Research & source triangulation
- Attention to detail
- Written precision
- Self-direction & reliability
- Analytical thinking
5 openings
Open worldwide
About micro1
micro1 is an AI data lab that hires remote experts to train and evaluate models. The original posting is on their site.
View this job on micro1Similar jobs
Research Evaluation Specialist (PhD or Masters / Researcher / Professor)
The Research Evaluation Specialist creates original, high-difficulty questions and verified answers to rigorously test and train advanced AI models. Applicants must hold a Master's or PhD, possess deep subject matter expertise, and have prior experience in AI training.
- Research & source triangulation
- Attention to detail
- Written precision
- +3
Posted 14 days ago$30 to $60/h
Domain Contributor - Evaluation Specialist
The Evaluation Specialist designs domain-specific tasks and assesses artificial intelligence outputs to identify reasoning flaws. Candidates need proven experience in AI model training or evaluation and deep subject expertise in fields like law, finance, or technology.
- Domain depth
- Source verification
- Reasoning clarity
- +1
Posted 13 days ago$30 to $60/h
Generalist
Contractors execute digital workflows, evaluate AI outputs, and provide structured feedback to improve next-generation AI systems. Key requirements include professional work experience, hands-on familiarity with AI tools, and strong digital literacy.
- Generalist
- ChatGPT Proficiency
- Problem Solving
- +4
Posted 11 days ago$30 to $49/h
AI Product Evaluator
The AI Product Evaluator tests models and agents against specific scenarios, documents findings in structured reports, and submits datasets. The role requires experience with AI products or evaluation, along with the ability to follow complex instructions with precision.
- AI Models
- AI Agents
- Following Instructions
- +1
Posted 18 days ago$14 to $36/h
