Clinical Mental Health Expert, AI Conversation Evaluation

Mercor is seeking Clinical Mental Health Experts to support an AI research initiative focused on evaluating the realism and quality of simulated clinical conversations. This is a short-term, fully remote evaluation task designed for mental health professionals who can apply their clinical experience and professional judgment to assess realistic conversational scenarios. The task will take up to 30 minutes to complete.

What You’ll Do

• Review pairs of simulated conversations involving clinical mental health scenarios.

• Evaluate the conversations based on their realism and authenticity.

• Determine which conversation more closely reflects a realistic clinical interaction.

• Apply your clinical experience and professional judgment when making evaluations.

• Complete the evaluation independently through an online interface.

Ideal Background

We welcome professionals with a relevant degree and clinical mental health expertise. Suitable backgrounds may include:

• Clinical Psychology

• Counselling Psychology

• Mental Health Counselling

• Clinical Social Work

• Psychiatry

• Psychotherapy

• Behavioural Health

• Marriage and Family Therapy

• Other closely related clinical mental health disciplines

Candidates should have:

• A relevant degree or professional qualification in a mental health-related field.

• Practical experience working in a clinical mental health or behavioural health setting.

• Familiarity with real-world conversations between mental health professionals and patients or clients.

• Strong professional judgment and the ability to identify whether clinical interactions feel realistic and authentic.

• Strong attention to detail and the ability to make independent qualitative assessments.

Why Join

• Apply your clinical expertise to the evaluation of advanced AI systems.

• Contribute to research aimed at improving the realism and quality of AI-generated interactions.

• Be considered for future AI evaluation and research opportunities requiring clinical mental health expertise.