Full-Stack Code Output Evaluator
Claru • Remote
Education
Not stated
Type
Hourly
Pay Rate
$55–$100/hr
Listed
13d ago
About this role
From the Claru listing
You'll review AI-generated code across the full web stack — JavaScript, TypeScript, Java backend services, and Node.js APIs — assessing correctness, security, maintainability, and adherence to the task specification. For each task, you receive a prompt that was given to a code-generating model and the code it produced. You run the code (in a provided sandbox or your local environment), verify it works as specified, and score it on multiple rubric dimensions. If the code is broken or insecure, you document exactly why, with line-level references.
Workflows include side-by-side comparison tasks (picking the better of two model outputs with written justification), single-output correctness reviews (does this code do what the prompt asked?), and security-flag tasks (does this output introduce SQL injection, XSS, or insecure dependency patterns?). You'll also encounter backend architecture tasks where you evaluate whether a Node.js or Java service is structured sensibly for the stated use case — not just whether it runs, but whether a senior engineer would accept it in a real PR. Some tasks use Eclipse-based Java projects; comfort navigating that toolchain is expected.
You should have at least 4 years of professional full-stack development experience, with production-level fluency in JavaScript/TypeScript and Java. You don't need to write new features — your job is to read and judge code quickly and accurately. Annotators who've done code review as part of a senior or lead engineering role tend to calibrate well for this work.
Requirements
- Must be eligible to work in Remote
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
- Bachelor's degree or equivalent professional experience
- Demonstrated expertise in Software Engineering
Interview Prep
This listing calls for these tools directly. Prep for the technical screen:
Why this role
At $55–$100/hr, this remote Full-Stack Code Output Evaluator role pays competitively without asking you to relocate, interview in person, or keep fixed hours in Software Engineering.
Skills and categories
Explore other opportunities in related specializations:
Related jobs
Browse All Jobs from Claru
Discover more opportunities on Claru that match your skills and interests.
View All Claru Jobs →Verified Reviews
Community Reviews
Share your experience with Claru
Help other candidates make better decisions by leaving a review.
Sign in to leave a reviewLeave your review
Common questions
What makes this one of Claru's higher-paying roles?
Claru bands its desk-based work by how much judgement a task needs. This listing sits in the top band at $55-$100/hr, alongside its RLHF evaluation, medical and 3D vision annotation and red-teaming roles, all of which expect graduate-level or professional depth in the subject and the ability to justify a score in writing. Its entry-tier text labeling sits at $20-$35/hr for comparison.
Is Claru desk work a steady queue or does it arrive in batches?
Batches. Claru describes this work as asynchronous with no scheduled hours and no meetings: you claim a batch, complete it and submit. There is no guarantee a new batch is waiting when you finish one, so treat it as recurring project income rather than a fixed weekly wage.
Do I need to install anything to do the work?
No. Claru's annotation and evaluation work runs in browser-based tools, including third-party platforms such as Segments.ai for 3D work and DICOM viewers for medical imaging, so there is no local install to maintain.
Does Claru publish the rate before I apply?
Yes. Every listing on claru.ai/jobs shows its hourly band on the card and again on the role page, so you can compare a $20-$35/hr labeling role against a $55-$100/hr evaluation role without creating an account first.
What does task-based AI training work look like?
Practical, hands-on data work: recording short videos, categorizing images, rating text responses, or analyzing data. Tasks are designed to be short and distinct, typically 5 to 60 minutes each.
What does asynchronous AI training work mean in practice?
No set hours, no check-ins, no meetings. You log in when you want, pick up an available task, complete it, and submit; nobody is waiting on you in real time. That's different from remote employment, where you're expected online during business hours. The tradeoff: you're competing with others for available tasks, so an empty queue means there's simply nothing to do until more work is released.
What does Software Engineering work look like for a Full-Stack Code Output Evaluator?
Tasks here are scoped to Software Engineering, not generic labeling. As a Full-Stack Code Output Evaluator, expect to draw on real domain judgment (evaluating outputs, correcting errors, or providing expert reasoning specific to Software Engineering) rather than following a one-size-fits-all rubric. If you don't have hands-on Software Engineering background, this is likely not the right listing to start with.
What specific skills does this listing call for?
Coding, TypeScript, and JavaScript are named directly in the listing. If you don't have hands-on experience with these, expect the screening process to test for them directly rather than accepting adjacent experience as a substitute.
How much does this specific role pay?
This listing is posted at $55–$100/hr, an hourly rate. The range reflects experience level and negotiated terms, not a placeholder, so where you land in it depends on your background and the assessment. Pay can change between when we last checked the listing and when you apply, so confirm the current number on the platform's own application page before committing time.
What happens when I click Apply on this listing?
You'll be taken to Claru's external site to complete your application there. This listing links through a referral, but the process is identical to applying directly; the link just routes you correctly. Create an account on their site and follow their onboarding steps.
Who is behind Claru?
Claru is the contributor-facing brand of Reka AI, which collects human data for frontier AI labs across text, vision, video and robotics. Its board splits into regional video capture work and desk-based annotation and evaluation, and the apply link on this page is an affiliate link that does not change your pay or what you are offered.