Japanese AI Evaluation Specialist (Japan)

Probably not a good fit. Handshake's AI Fellowship roles target current university students and early talent within about 1-2 years of graduation. Experienced professionals typically find faster approval and better rates on Outlier or Mercor.

For the AI Fellowship roles specifically, yes, Handshake acts as the employer of record. That's different from the rest of the site, which functions as a job board listing openings for other companies.

Practical, hands-on data work: recording short videos, categorizing images, rating text responses, or analyzing data. Tasks are designed to be short and distinct, typically 5 to 60 minutes each.

No set hours, no check-ins, no meetings. You log in when you want, pick up an available task, complete it, and submit; nobody is waiting on you in real time. That's different from remote employment, where you're expected online during business hours. The tradeoff: you're competing with others for available tasks, so an empty queue means there's simply nothing to do until more work is released.

Tasks here are scoped to Languages, not generic labeling. As a Japanese AI Evaluation Specialist (Japan), expect to draw on real domain judgment (evaluating outputs, correcting errors, or providing expert reasoning specific to Languages) rather than following a one-size-fits-all rubric. If you don't have hands-on Languages background, this is likely not the right listing to start with.

English and Japanese are named directly in the listing. If you don't have hands-on experience with these, expect the screening process to test for them directly rather than accepting adjacent experience as a substitute.

This listing is posted at $30/hr, an hourly rate. Pay can change between when we last checked the listing and when you apply, so confirm the current number on the platform's own application page before committing time.

Yes. This role specifically requires English or Japanese proficiency, on top of the English most AI training work assumes by default. If English is not a language you're fluent in, this is not the right role. Filter for your native language to find better-matched listings.

You'll be taken to Handshake's external site to complete your application there. This listing links through a referral, but the process is identical to applying directly; the link just routes you correctly. Create an account on their site and follow their onboarding steps.

This specific role is open only to people based in Japan. If you are somewhere else, applying is unlikely to lead to an offer even if you pass the assessment, because the restriction is usually about where the work can legally be contracted rather than your skills. Read the full description for any tax-residency or right-to-work caveats before you apply.

Some are, some aren't. Handshake lists both standard internships and separate "AI Trainer" fellowships. Check the job description for "1099" or "Contract" language: that signals a freelance role, not W-2 employment.