AI Evaluation Specialist

Probably not a good fit. Handshake's AI Fellowship roles target current university students and early talent within about 1-2 years of graduation. Experienced professionals typically find faster approval and better rates on Outlier or Mercor.

For the AI Fellowship roles specifically, yes, Handshake acts as the employer of record. That's different from the rest of the site, which functions as a job board listing openings for other companies.

Most skip a live interview entirely and gate access through an automated assessment or qualification task instead. Where we've confirmed the specific requirement for this listing, it's called out above in What We Know About This Role.

Practical, hands-on data work: recording short videos, categorizing images, rating text responses, or analyzing data. Tasks are designed to be short and distinct, typically 5 to 60 minutes each.

Tasks here are scoped to Generalist, not generic labeling. As an AI Evaluation Specialist, expect to draw on real domain judgment (evaluating outputs, correcting errors, or providing expert reasoning specific to Generalist) rather than following a one-size-fits-all rubric. If you don't have hands-on Generalist background, this is likely not the right listing to start with.

Expert and AI Training are named directly in the listing. If you don't have hands-on experience with these, expect the screening process to test for them directly rather than accepting adjacent experience as a substitute.

This listing is posted at $15/hr, an hourly rate. Pay can change between when we last checked the listing and when you apply, so confirm the current number on the platform's own application page before committing time.

You'll be taken to Handshake's external site to complete your application there. This listing links through a referral, but the process is identical to applying directly; the link just routes you correctly. Create an account on their site and follow their onboarding steps.

This specific role is open only to people based in Canada. If you are somewhere else, applying is unlikely to lead to an offer even if you pass the assessment, because the restriction is usually about where the work can legally be contracted rather than your skills. Read the full description for any tax-residency or right-to-work caveats before you apply.

Some are, some aren't. Handshake lists both standard internships and separate "AI Trainer" fellowships. Check the job description for "1099" or "Contract" language: that signals a freelance role, not W-2 employment.