AI Evaluation Specialist
Handshake • Remote
Education
Associate
Type
Hourly
Pay Rate
$40/hr
Listed
7d ago
Apply opens Handshake in a new tab.
Apply Now → ⚡ Boost your chances - Optimize your resume with Rezi.aiAbout this role
From the Handshake listing
Overview
Handshake is seeking motivated Associates, Bachelor’s, and Master’s students and grads to work remotely to test Large Language Models (LLMs) in collaboration with top AI labs. As part of this program, you’ll apply your overall skills and academic knowledge to help improve the performance of LLMs. All disciplines and majors are welcome to apply.
Handshake AI projects are remote and part-time opportunities.
Details
Work remotely and independently on short-term AI training projects, with no minimum commitment to hours.
No specific expertise required, just attention to detail. We’ll provide a brief training, and you’ll take a single assessment before starting.
Learn how frontier AI labs are training their models while getting paid.
Successful experience leads to eligibility for more projects in the future.
Shape the future of AI while building skills and confidence to navigate an AI-driven job market.
Qualifications
Current students pursuing an Associate’s, Bachelor’s, or Master’s degree or those already holding degrees
Individuals with exceptional attention to detail and the ability to follow detailed instructions accurately
Candidates comfortable working in a primarily asynchronous, remote environment in collaboration with leading AI research labs
People who believe their knowledge and reasoning skills can challenge today’s most advanced AI systems
The application process
Sign up and create an account
Verify your identity
Join and onboard into relevant projects
Start working and earning
Why this role
This AI Evaluation Specialist role pays $40/hr fully remote, so the Generalist work here isn't limited to whoever happens to live near an AI lab's office.
Skills and categories
Explore other opportunities in related specializations:
Related jobs
Browse All Jobs from Handshake
Discover more opportunities on Handshake that match your skills and interests.
View All Handshake Jobs →Verified Reviews
Community Reviews
Share your experience with Handshake
Help other candidates make better decisions by leaving a review.
Sign in to leave a reviewLeave your review
Common questions
Can I use Handshake if I graduated years ago?
Probably not a good fit. Handshake's AI Fellowship roles target current university students and early talent within about 1-2 years of graduation. Experienced professionals typically find faster approval and better rates on Outlier or Mercor.
Is Handshake itself the employer for AI training roles?
For the AI Fellowship roles specifically, yes, Handshake acts as the employer of record. That's different from the rest of the site, which functions as a job board listing openings for other companies.
What does task-based AI training work look like?
Practical, hands-on data work: recording short videos, categorizing images, rating text responses, or analyzing data. Tasks are designed to be short and distinct, typically 5 to 60 minutes each.
What does asynchronous AI training work mean in practice?
No set hours, no check-ins, no meetings. You log in when you want, pick up an available task, complete it, and submit; nobody is waiting on you in real time. That's different from remote employment, where you're expected online during business hours. The tradeoff: you're competing with others for available tasks, so an empty queue means there's simply nothing to do until more work is released.
What does Generalist work look like for an AI Evaluation Specialist?
Tasks here are scoped to Generalist, not generic labeling. As an AI Evaluation Specialist, expect to draw on real domain judgment (evaluating outputs, correcting errors, or providing expert reasoning specific to Generalist) rather than following a one-size-fits-all rubric. If you don't have hands-on Generalist background, this is likely not the right listing to start with.
What specific skills does this listing call for?
Expert and AI Training are named directly in the listing. If you don't have hands-on experience with these, expect the screening process to test for them directly rather than accepting adjacent experience as a substitute.
How much does this specific role pay?
This listing is posted at $40/hr, an hourly rate. Pay can change between when we last checked the listing and when you apply, so confirm the current number on the platform's own application page before committing time.
What happens when I click Apply on this listing?
You'll be taken to Handshake's external site to complete your application there. This listing links through a referral, but the process is identical to applying directly; the link just routes you correctly. Create an account on their site and follow their onboarding steps.
Are Handshake AI training listings internships?
Some are, some aren't. Handshake lists both standard internships and separate "AI Trainer" fellowships. Check the job description for "1099" or "Contract" language: that signals a freelance role, not W-2 employment.