Psychologist – EQ & Theory of Mind Annotator

We are looking for licensed psychologists, clinical psychologists, or researchers with expertise in social cognition to join Project TOM — a high-level Emotional Intelligence (EQ) annotation project evaluating AI model reasoning in complex interpersonal scenarios.

What you’ll do:

• Evaluate AI model responses across 7 Theory of Mind (ToM) dimensions: Intentions (T1), Emotions (T2), Desires (T3), Percepts (T4), Knowledge (T5), Beliefs (T6), and Non-literal Communication / Subtext (T7)

• Compare two AI model outputs (Model A vs. Model B) and select the preferred response with a written rationale (~50 words per dimension)

• Assess whether AI models correctly diagnose mental states (Stage 1), form coherent behavioral strategies (Stage 2), and produce psychologically authentic final responses (Stage 3)

• Identify false beliefs, emotional misattributions, hallucinated knowledge states, and failures of Theory of Mind reasoning

• Flag scenarios with severe logical contradictions or detachment from realistic interpersonal dynamics

What we’re looking for:

• Licensed psychologist, clinical psychologist, counselor, or researcher with expertise in social cognition, ToM, or interpersonal psychology

• Strong ability to perceive subtext, emotional undercurrents, and causal chains in human behavior

• Experience with sentiment analysis, behavioral assessment, or text-based psychological evaluation

• Familiarity with Eastern and Western cultural norms in interpersonal conflict resolution

• Remote, flexible schedule | ~1-1.25 hrs per task | Paid hourly

• Pilot phase: 30 entries before full production

• Triple-blind annotation: each task reviewed by 3 independent annotators

• Target accuracy: 80%+ label consistency with Gold Standard

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.