Legal Reasoning AI Response Evaluator
Claru • Remote
Education
Not stated
Type
Hourly
Pay Rate
$55–$100/hr
Listed
13d ago
About this role
From the Claru listing
You'll evaluate AI-generated responses to legal questions — covering case analysis, statutory interpretation, procedural questions, and litigation strategy. Your primary task is assessing whether a model's answer reflects sound legal reasoning, accurate doctrinal knowledge, and appropriate caveats. This isn't about copy-editing; you're judging whether the legal analysis would hold up in front of a practitioner, and flagging anything that could mislead a non-expert relying on the output.
Day-to-day work involves reading a legal prompt, reviewing the model's response, and scoring it across dimensions like analytical rigor, jurisdictional accuracy, and practical usefulness. For litigation-focused tasks, you'll also evaluate whether the model correctly identifies procedural posture, burden of proof, and viable arguments. Feedback is written in structured rubric fields, with an optional free-text section for nuanced critique. Tasks are asynchronous — you work batches on your own schedule through a browser-based annotation platform.
A minimum of 3 years of litigation or substantive legal practice is required. Familiarity with U.S. federal and state court procedure is expected; experience in additional jurisdictions is a bonus. Law professors and clerks are also strong candidates. You do not need to be currently practicing, but you must be able to credibly evaluate whether legal reasoning is sound, not just grammatically correct.
Requirements
- Must be eligible to work in Remote
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
- Bachelor's degree or equivalent professional experience
- Demonstrated expertise in Legal
Why this role
At $55–$100/hr, this remote Legal Reasoning AI Response Evaluator role pays competitively without asking you to relocate, interview in person, or keep fixed hours in Legal.
Talent pool
We're light on Legal candidates
We've matched 7 people with a Legal background against 209 Legal listings we've tracked, so most go out without one. Set up a profile and we'll consider you for a role like this one.
Set up your profileSkills and categories
Explore other opportunities in related specializations:
Related jobs
Browse All Jobs from Claru
Discover more opportunities on Claru that match your skills and interests.
View All Claru Jobs →Verified Reviews
Community Reviews
Share your experience with Claru
Help other candidates make better decisions by leaving a review.
Sign in to leave a reviewLeave your review
Common questions
What makes this one of Claru's higher-paying roles?
Claru bands its desk-based work by how much judgement a task needs. This listing sits in the top band at $55-$100/hr, alongside its RLHF evaluation, medical and 3D vision annotation and red-teaming roles, all of which expect graduate-level or professional depth in the subject and the ability to justify a score in writing. Its entry-tier text labeling sits at $20-$35/hr for comparison.
Is Claru desk work a steady queue or does it arrive in batches?
Batches. Claru describes this work as asynchronous with no scheduled hours and no meetings: you claim a batch, complete it and submit. There is no guarantee a new batch is waiting when you finish one, so treat it as recurring project income rather than a fixed weekly wage.
Can I work on Claru from outside the United States?
For the desk-based annotation and evaluation roles, yes: they are listed as remote with no country gate. The country restrictions on Claru apply to its video capture listings, which are limited to the specific markets named on each one.
Do I need to install anything to do the work?
No. Claru's annotation and evaluation work runs in browser-based tools, including third-party platforms such as Segments.ai for 3D work and DICOM viewers for medical imaging, so there is no local install to maintain.
Is AI training work the same as traditional consulting?
No. Instead of client deliverables, you're given complex scenarios to evaluate: grading the AI's logic, correcting its hallucinations, and supplying expert-level reasoning it doesn't have on its own. The job is closer to teaching than consulting.
Why do these AI training roles pay so much?
Because general knowledge isn't what's being tested. The model already knows the basics; what it needs is expertise on edge cases, the rare, difficult, highly technical judgment calls only a senior professional in the field would make correctly.
What does Legal work look like for a Legal Reasoning AI Response Evaluator?
Tasks here are scoped to Legal, not generic labeling. As a Legal Reasoning AI Response Evaluator, expect to draw on real domain judgment (evaluating outputs, correcting errors, or providing expert reasoning specific to Legal) rather than following a one-size-fits-all rubric. If you don't have hands-on Legal background, this is likely not the right listing to start with.
What specific skills does this listing call for?
Expert is named directly in the listing. If you don't have hands-on experience with this, expect the screening process to test for it directly rather than accepting adjacent experience as a substitute.
How much does this specific role pay?
This listing is posted at $55–$100/hr, an hourly rate. The range reflects experience level and negotiated terms, not a placeholder, so where you land in it depends on your background and the assessment. Pay can change between when we last checked the listing and when you apply, so confirm the current number on the platform's own application page before committing time.
What happens when I click Apply on this listing?
You'll be taken to Claru's external site to complete your application there. This listing links through a referral, but the process is identical to applying directly; the link just routes you correctly. Create an account on their site and follow their onboarding steps.
Who is behind Claru?
Claru is the contributor-facing brand of Reka AI, which collects human data for frontier AI labs across text, vision, video and robotics. Its board splits into regional video capture work and desk-based annotation and evaluation, and the apply link on this page is an affiliate link that does not change your pay or what you are offered.