Psychologist – EQ & Theory of Mind Annotator
Mercor • Remote
Education
Not stated
Type
Hourly
Pay Rate
$38/hr
Listed
175d ago
Apply opens Mercor in a new tab.
Apply Now → ⚡ Boost your chances - Optimize your resume with Rezi.aiAbout this role
From the Mercor listing
We are looking for licensed psychologists, clinical psychologists, or researchers with expertise in social cognition to join Project TOM — a high-level Emotional Intelligence (EQ) annotation project evaluating AI model reasoning in complex interpersonal scenarios.
What you’ll do:
• Evaluate AI model responses across 7 Theory of Mind (ToM) dimensions: Intentions (T1), Emotions (T2), Desires (T3), Percepts (T4), Knowledge (T5), Beliefs (T6), and Non-literal Communication / Subtext (T7)
• Compare two AI model outputs (Model A vs. Model B) and select the preferred response with a written rationale (~50 words per dimension)
• Assess whether AI models correctly diagnose mental states (Stage 1), form coherent behavioral strategies (Stage 2), and produce psychologically authentic final responses (Stage 3)
• Identify false beliefs, emotional misattributions, hallucinated knowledge states, and failures of Theory of Mind reasoning
• Flag scenarios with severe logical contradictions or detachment from realistic interpersonal dynamics
What we’re looking for:
• Licensed psychologist, clinical psychologist, counselor, or researcher with expertise in social cognition, ToM, or interpersonal psychology
• Strong ability to perceive subtext, emotional undercurrents, and causal chains in human behavior
• Experience with sentiment analysis, behavioral assessment, or text-based psychological evaluation
• Familiarity with Eastern and Western cultural norms in interpersonal conflict resolution
• Remote, flexible schedule | ~1-1.25 hrs per task | Paid hourly
• Pilot phase: 30 entries before full production
• Triple-blind annotation: each task reviewed by 3 independent annotators
• Target accuracy: 80%+ label consistency with Gold Standard
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
How long hiring takes
Across the AI training platforms we refer candidates to, the median gap between referral and hire is about 30 days. It varies by platform and role, so treat it as a rough guide for this one.
Talent Pool members
Apply through this link and we can put you forward to Mercor when your profile is a strong match. Not every applicant is submitted. If you're not in the pool yet, set up your profile first.
Set up your profile →Why this role
At $38/hr, this remote Psychologist – EQ & Theory of Mind Annotator role pays competitively without asking you to relocate, interview in person, or keep fixed hours in Psychology.
Talent pool
We're light on Psychology candidates
We've matched 33 people with a Psychology background against 373 Psychology listings we've tracked, so most go out without one. Set up a profile and we'll consider you for a role like this one.
Set up your profileSkills and categories
Explore other opportunities in related specializations:
Related jobs
Browse All Jobs from Mercor
Discover more opportunities on Mercor that match your skills and interests.
View All Mercor Jobs →Verified Reviews
Community Reviews
Share your experience with Mercor
Help other candidates make better decisions by leaving a review.
Sign in to leave a reviewLeave your review
Common questions
Does it cost money to apply to Mercor?
No, applying and joining Mercor is free. Mercor's revenue comes from a fee it charges the client on top of your hourly rate, not from applicants. Treat any request for payment to join as a red flag.
Is Mercor for freelancers or full-time contractors?
Mercor places you with one client for a defined engagement, like 'Python Tutor for 3 months', rather than having you grab small tasks from a shared queue. Most roles function as steady contract work, not one-off gigs.
What does task-based AI training work look like?
Practical, hands-on data work: recording short videos, categorizing images, rating text responses, or analyzing data. Tasks are designed to be short and distinct, typically 5 to 60 minutes each.
What does asynchronous AI training work mean in practice?
No set hours, no check-ins, no meetings. You log in when you want, pick up an available task, complete it, and submit; nobody is waiting on you in real time. That's different from remote employment, where you're expected online during business hours. The tradeoff: you're competing with others for available tasks, so an empty queue means there's simply nothing to do until more work is released.
What does Psychology work look like for a Psychologist – EQ & Theory of Mind Annotator?
Tasks here are scoped to Psychology, not generic labeling. As a Psychologist – EQ & Theory of Mind Annotator, expect to draw on real domain judgment (evaluating outputs, correcting errors, or providing expert reasoning specific to Psychology) rather than following a one-size-fits-all rubric. If you don't have hands-on Psychology background, this is likely not the right listing to start with.
What specific skills does this listing call for?
Data Annotation and Entry Level are named directly in the listing. If you don't have hands-on experience with these, expect the screening process to test for them directly rather than accepting adjacent experience as a substitute.
How much does this specific role pay?
This listing is posted at $38/hr, an hourly rate. Pay can change between when we last checked the listing and when you apply, so confirm the current number on the platform's own application page before committing time.
What happens when I click Apply on this listing?
You'll be taken to Mercor's external site to complete your application there. This listing links through a referral, but the process is identical to applying directly; the link just routes you correctly. Create an account on their site and follow their onboarding steps.
How soon will I start working after applying to Mercor?
Not immediately. Mercor is a talent marketplace, not a task queue, so applying puts you in a pool of candidates. You start working only once a specific client, like a major AI lab, selects your profile, and that matching process can take weeks.