Legal Expert

Location: Geography restricted to USA, EU, UK, Canada Type: Full-time or Part-time Contract Work Fluent Language Skills Required: English

Why This Role Exists

Location

Type

Fluent Language Skills Required

Why This Role Exists

What You’ll Do

Write and refine prompts

Evaluate LLM-generated responses

Conduct fact-checking

Annotate model responses

Assess tone, completeness, and appropriateness of responses

model responses align with expected conversational behavior

Apply consistent evaluation standards

Who You Are

minimum of 5 years of real-world professional experience in Law

associated expert degree

one or more of the following sub-domains

significant experience using large language models

excellent writing skills

comfortable evaluating complex arguments

identifying subtle reasoning or detail-level issues

Nice-to-Have Specialties

What Success Looks Like

Why Join Mercor

Location: Geography restricted to USA, EU, UK, Canada Type: Full-time or Part-time Contract Work Fluent Language Skills Required: English Why This Role Exists Mercor partners with leading AI teams to improve the quality, usefulness, and reliability of general-purpose conversational AI systems. These systems are used across a wide range of everyday and professional scenarios, and their effectiveness depends on how clearly, accurately, and helpfully they respond to real user questions. In legal contexts, precision, clarity, and correct reasoning are critical. This project focuses on evaluating and improving conversational AI behavior when responding to legal questions, explanations, and analyses. Your expertise helps ensure model responses reflect accurate legal understanding, appropriate reasoning, and responsible communication aligned with real-world legal practice. What You’ll Do Write and refine prompts to guide model behavior in legal use cases Evaluate LLM-generated responses to legal queries for accuracy, reasoning, clarity, and completeness Conduct fact-checking using trusted public sources and authoritative references Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies Assess tone, completeness, and appropriateness of responses for real-world legal scenarios Ensure model responses align with expected conversational behavior and system guidelines Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines Who You Are You have a minimum of 5 years of real-world professional experience in Law, supported by an associated expert degree (e.g., JD, LLB, LLM, or equivalent) You have experience in one or more of the following sub-domains: Corporate, Business & Commercial Law Employment, Labor & Human Rights Public, Criminal & International Governance Private Law You have significant experience using large language models (LLMs) and understand how and why people use them You have excellent writing skills and can clearly explain complex legal concepts You are comfortable evaluating complex arguments and identifying subtle reasoning or detail-level issues that others may overlook. Nice-to-Have Specialties Prior experience with RLHF, model evaluation, or data annotation work Experience writing or editing high-quality legal or analytical content Experience translating legal concepts for non-legal audiences Familiarity with evaluation rubrics, benchmarks, or quality scoring systems What Success Looks Like You uncover legal inaccuracies, misleading reasoning, or unclear explanations in model outputs Your evaluations improve the reliability and clarity of legal AI responses You deliver structured, reproducible feedback that meaningfully improves model performance Mercor customers trust their AI systems in legal contexts because you’ve rigorously evaluated them Why Join Mercor Mercor offers legal professionals the opportunity to apply their expertise beyond traditional practice, shaping how AI systems reason about and communicate legal information. This flexible, remote role allows you to contribute directly to the future of legal AI while working on intellectually rigorous, high-impact projects. We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

• Write and refine prompts to guide model behavior in legal use cases
• Evaluate LLM-generated responses to legal queries for accuracy, reasoning, clarity, and completeness
• Conduct fact-checking using trusted public sources and authoritative references
• Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies
• Assess tone, completeness, and appropriateness of responses for real-world legal scenarios
• Ensure model responses align with expected conversational behavior and system guidelines
• Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines
• You have a minimum of 5 years of real-world professional experience in Law, supported by an associated expert degree (e.g., JD, LLB, LLM, or equivalent)
• You have experience in one or more of the following sub-domains:

Corporate, Business & Commercial Law

Employment, Labor & Human Rights

Public, Criminal & International Governance

Private Law

• Corporate, Business & Commercial Law
• Employment, Labor & Human Rights
• Public, Criminal & International Governance
• Private Law
• You have significant experience using large language models (LLMs) and understand how and why people use them
• You have excellent writing skills and can clearly explain complex legal concepts
• You are comfortable evaluating complex arguments and identifying subtle reasoning or detail-level issues that others may overlook.
• Corporate, Business & Commercial Law
• Employment, Labor & Human Rights
• Public, Criminal & International Governance
• Private Law
• Prior experience with RLHF, model evaluation, or data annotation work
• Experience writing or editing high-quality legal or analytical content
• Experience translating legal concepts for non-legal audiences
• Familiarity with evaluation rubrics, benchmarks, or quality scoring systems
• You uncover legal inaccuracies, misleading reasoning, or unclear explanations in model outputs
• Your evaluations improve the reliability and clarity of legal AI responses
• You deliver structured, reproducible feedback that meaningfully improves model performance
• Mercor customers trust their AI systems in legal contexts because you’ve rigorously evaluated them