Python Code Generation Reviewer
Claru • Remote
Education
Not stated
Type
Hourly
Pay Rate
$35–$55/hr
Listed
13d ago
About this role
From the Claru listing
Your primary work is reviewing Python code produced by language models in response to natural-language coding prompts. For each task you'll receive the original prompt, one or more model-generated code snippets, and a rubric covering correctness, efficiency, readability, and edge-case handling. You'll run or mentally trace the code, identify bugs or logic errors, and submit structured feedback — including a preference ranking if multiple variants are presented and inline comments where issues occur.
Tasks arrive through a web-based review interface. You'll encounter a mix of prompt types: algorithmic challenges (sorting, graph traversal, dynamic programming), data manipulation with pandas or NumPy, API integration stubs, and general scripting tasks. Some sessions focus on ranking two completions; others ask you to rewrite a flawed snippet to a higher standard. You'll be working asynchronously and should expect 6–10 tasks per hour depending on code length and complexity.
Ideal candidates have 2+ years of Python development experience and are comfortable quickly reading unfamiliar code without an IDE scaffolding everything for you. You don't need deep ML knowledge — the job is software quality review, not model development. Familiarity with common Python anti-patterns, time complexity basics, and standard library modules (itertools, collections, os, etc.) will serve you well.
Requirements
- Must be eligible to work in Remote
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
Interview Prep
This listing calls for this tool directly. Prep for the technical screen:
Why this role
Being remote means this Python Code Generation Reviewer position pays $35–$55/hr regardless of your zip code, opening up Software Engineering work that used to require living in one of a handful of cities.
Skills and categories
Explore other opportunities in related specializations:
Related jobs
Browse All Jobs from Claru
Discover more opportunities on Claru that match your skills and interests.
View All Claru Jobs →Verified Reviews
Community Reviews
Share your experience with Claru
Help other candidates make better decisions by leaving a review.
Sign in to leave a reviewLeave your review
Common questions
What makes this one of Claru's higher-paying roles?
Claru bands its desk-based work by how much judgement a task needs. This listing sits in the top band at $35-$55/hr, alongside its RLHF evaluation, medical and 3D vision annotation and red-teaming roles, all of which expect graduate-level or professional depth in the subject and the ability to justify a score in writing. Its entry-tier text labeling sits at $20-$35/hr for comparison.
Is Claru desk work a steady queue or does it arrive in batches?
Batches. Claru describes this work as asynchronous with no scheduled hours and no meetings: you claim a batch, complete it and submit. There is no guarantee a new batch is waiting when you finish one, so treat it as recurring project income rather than a fixed weekly wage.
Does Claru publish the rate before I apply?
Yes. Every listing on claru.ai/jobs shows its hourly band on the card and again on the role page, so you can compare a $20-$35/hr labeling role against a $55-$100/hr evaluation role without creating an account first.
How does Claru measure quality on this kind of work?
Through agreement scoring and review. Its evaluation roles set a target for how closely your scores track other annotators, and disagreements with reviewers are resolved in an async comment thread you are expected to answer within a day. Consistently strong scores are what unlock the senior and lead tracks Claru mentions in its listings.
Do task-based AI training roles require an interview?
Most skip a live interview entirely and gate access through an automated assessment or qualification task instead. Where we've confirmed the specific requirement for this listing, it's called out above in What We Know About This Role.
What does task-based AI training work look like?
Practical, hands-on data work: recording short videos, categorizing images, rating text responses, or analyzing data. Tasks are designed to be short and distinct, typically 5 to 60 minutes each.
What does Software Engineering work look like for a Python Code Generation Reviewer?
Tasks here are scoped to Software Engineering, not generic labeling. As a Python Code Generation Reviewer, expect to draw on real domain judgment (evaluating outputs, correcting errors, or providing expert reasoning specific to Software Engineering) rather than following a one-size-fits-all rubric. If you don't have hands-on Software Engineering background, this is likely not the right listing to start with.
What specific skills does this listing call for?
Coding and Python are named directly in the listing. If you don't have hands-on experience with these, expect the screening process to test for them directly rather than accepting adjacent experience as a substitute.
How much does this specific role pay?
This listing is posted at $35–$55/hr, an hourly rate. The range reflects experience level and negotiated terms, not a placeholder, so where you land in it depends on your background and the assessment. Pay can change between when we last checked the listing and when you apply, so confirm the current number on the platform's own application page before committing time.
What happens when I click Apply on this listing?
You'll be taken to Claru's external site to complete your application there. This listing links through a referral, but the process is identical to applying directly; the link just routes you correctly. Create an account on their site and follow their onboarding steps.
Who is behind Claru?
Claru is the contributor-facing brand of Reka AI, which collects human data for frontier AI labs across text, vision, video and robotics. Its board splits into regional video capture work and desk-based annotation and evaluation, and the apply link on this page is an affiliate link that does not change your pay or what you are offered.