Search Generalists
Mercor • Remote
Education
Bachelor's
Type
Hourly
Pay Rate
$10–$30/hr
Listed
180d ago
Apply opens Mercor in a new tab.
Apply Now → ⚡ Boost your chances - Optimize your resume with Rezi.aiAbout this role
From the Mercor listing
Mercor is seeking detail-oriented Search Generalist Experts to support a high-impact project with a leading AI research lab. In this role, you will help evaluate and improve how advanced AI systems perform on real-world search and browsing tasks.
This work includes assessing model outputs for factuality, helpfulness, completeness, and judgment quality across a broad range of user queries. You will contribute to structured evaluation workflows that help train, benchmark, and refine frontier AI systems. This is a strong fit for excellent generalists who are sharp researchers, strong writers, and comfortable making nuanced quality judgments at scale.
- Evaluate AI-generated search responses for factual accuracy, helpfulness, clarity, completeness, and overall quality.
- Assess whether models use search appropriately and whether search queries are well-formed and effective.
- Compare model responses side by side and provide concise, defensible rationales.
- Write and refine prompts, golden answers, rubric criteria, and edge cases for search-related evaluations.
- Apply project guidelines consistently across ambiguous, multi-step, and real-world search tasks.
- Identify recurring failure modes and escalate unclear cases or rubric gaps to project leads.
- Participate in calibration, QA, and feedback loops to maintain strong agreement and quality standards.
- Excellent written English and strong online research skills.
- Strong judgment when synthesizing information from multiple sources.
- Ability to distinguish factual accuracy from fluency, confidence, or style.
- High attention to detail and comfort following structured guidelines.
- Reliable, self-directed, and responsive in an asynchronous remote environment.
- Experience in search quality, fact-checking, content evaluation, trust and safety, annotation, QA, or prompt/rubric writing.
- Familiarity with search evaluation concepts such as factuality, helpfulness, severity, side-by-side comparisons, or tool-use assessment.
- Experience working with LLM evaluation workflows or human data projects.
- Multilingual skills are a plus.
- Bachelor’s degree preferred; advanced degree or strong professional background is a plus.
Requirements
- Must be eligible to work in Remote
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
How long hiring takes
Across the AI training platforms we refer candidates to, the median gap between referral and hire is about 30 days. It varies by platform and role, so treat it as a rough guide for this one.
Talent Pool members
Apply through this link and we can put you forward to Mercor when your profile is a strong match. Not every applicant is submitted. If you're not in the pool yet, set up your profile first.
Set up your profile →What to Expect
Looking at Mercor Generalist listings we've tracked, contracts in this domain typically run about 6.8 weeks. Actual length varies by project, but this gives you a realistic baseline going in.
Based on 10 extracted Mercor Generalist listings.
Why this role
This Search Generalists role is fully remote and pays $10–$30/hr, a solid way into Generalist work without needing to live near an office or relocate for it.
Skills and categories
Explore other opportunities in related specializations:
Related jobs
Browse All Jobs from Mercor
Discover more opportunities on Mercor that match your skills and interests.
View All Mercor Jobs →Verified Reviews
Community Reviews
Share your experience with Mercor
Help other candidates make better decisions by leaving a review.
Sign in to leave a reviewLeave your review
Common questions
Is Mercor for freelancers or full-time contractors?
Mercor places you with one client for a defined engagement, like 'Python Tutor for 3 months', rather than having you grab small tasks from a shared queue. Most roles function as steady contract work, not one-off gigs.
Does Mercor's application require an on-camera interview?
Yes, every applicant records a video interview with an AI interviewer that asks questions about your resume. Clients review that recording to judge communication skills before matching, so there's no way to apply without going on camera.
What does asynchronous AI training work mean in practice?
No set hours, no check-ins, no meetings. You log in when you want, pick up an available task, complete it, and submit; nobody is waiting on you in real time. That's different from remote employment, where you're expected online during business hours. The tradeoff: you're competing with others for available tasks, so an empty queue means there's simply nothing to do until more work is released.
What does Generalist work look like for a Search Generalists?
Tasks here are scoped to Generalist, not generic labeling. As a Search Generalists, expect to draw on real domain judgment (evaluating outputs, correcting errors, or providing expert reasoning specific to Generalist) rather than following a one-size-fits-all rubric. If you don't have hands-on Generalist background, this is likely not the right listing to start with.
What specific skills does this listing call for?
Data Annotation, English, Multilingual, and Entry Level are named directly in the listing. If you don't have hands-on experience with these, expect the screening process to test for them directly rather than accepting adjacent experience as a substitute.
How much does this specific role pay?
This listing is posted at $10–$30/hr, an hourly rate. The range reflects experience level and negotiated terms, not a placeholder, so where you land in it depends on your background and the assessment. Pay can change between when we last checked the listing and when you apply, so confirm the current number on the platform's own application page before committing time.
What happens when I click Apply on this listing?
You'll be taken to Mercor's external site to complete your application there. This listing links through a referral, but the process is identical to applying directly; the link just routes you correctly. Create an account on their site and follow their onboarding steps.
How soon will I start working after applying to Mercor?
Not immediately. Mercor is a talent marketplace, not a task queue, so applying puts you in a pool of candidates. You start working only once a specific client, like a major AI lab, selects your profile, and that matching process can take weeks.