Repo-based Code Annotator
Remo Experts β’ Remote
Education
Any
Type
hourly
Pay Rate
$80/hr
Listed
129d ago
β Applying through this link supports our platform at no cost to you.
This position is hosted on an external talent platform. Please only apply for this position if it fits your skills and interests.
About this Role
From the Remo Experts listing
Build reproducible, standardized test environments using Docker images to accurately replicate known issues or generate expected outputs according to specified procedures.
Review and enhance the coverage and effectiveness of existing unit tests to assess the correctness and stability of target code.
Validate the completeness and rationality of test sets, ensuring that workflows for tasks related to SWE-Bench and Terminal-Bench are precisely aligned.
Write high-quality task documentation (task.yaml/README), emphasizing reproducibility and standardized processes.
Requirements
- Must be eligible to work in Remote
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
- Bachelor's degree or equivalent professional experience
- Demonstrated expertise in Software Engineering
Why This Role
Work from anywhere, at any time. This fully remote Repo-based Code Annotator position ($80/hr) breaks down geographic barriers, allowing you to earn US-competitive rates regardless of your local market. It is a perfect stepping stone for building a career in the Software Engineering ecosystem.
Skills & Categories
Explore other opportunities in related specializations:
Related Jobs
Engineering & Data tools Specialist
micro1 β’ Software Engineering
$80 /hr
QA / Software Engineering Reviewer β Browser Test Validation
mercor β’ Software Engineering
$60 /hr
Head of AI & Engineering Expert
ethos β’ Software Engineering
$150 /hr
Senior Machine Learning Engineer / Model Evaluations Expert
ethos β’ Software Engineering
$125 /hr
Browse All Jobs from Remo Experts
Discover more opportunities on Remo Experts that match your skills and interests.
View All Remo Experts Jobs βVerified Reviews
Community Reviews
Share your experience with Remo Experts
Help other candidates make better decisions by leaving a review.
Sign in to leave a reviewLeave your review
Frequently Asked Questions
How is Rex (Remo Experts) different from Outlier or Mindrift?
Rex focuses on cognition-heavy work: reasoning evaluation, prompt design, domain-specific content generation, and model benchmarking. Instead of high-volume microtask queues, it prioritizes fewer, deeper tasks and pays accordingly, with a stated target of $25-45/hr for expert-level output.
What is Rex's Superhuman Profile?
It's Rex's reputation system: a running score of your reliability, consistency, and task quality. A stronger profile unlocks higher-paying tracks and priority access to premium projects like Project EVA (with 2077AI), so every task you complete affects what you get offered next.
What kind of tasks does Rex assign?
RLHF and instruction-tuning dataset creation, LLM prompt and response evaluation, named entity recognition, computer vision annotation, content safety labeling, speech-to-text transcription, and red-teaming and safety evaluations. Your specific assignment depends on your skills and profile tier.
What does task-based AI training work actually look like?
Practical, hands-on data work: recording short videos, categorizing images, rating text responses, or analyzing data. Tasks are designed to be short and distinct, typically 5 to 60 minutes each.
What does asynchronous AI training work mean in practice?
No set hours, no check-ins, no meetings. You log in when you want, pick up an available task, complete it, and submit; nobody is waiting on you in real time. That's different from remote employment, where you're expected online during business hours. The tradeoff: you're competing with others for available tasks, so an empty queue means there's simply nothing to do until more work is released.
Do task-based AI training roles require an interview?
Check the Job Facts panel above for this specific listing. Where no fact is confirmed yet: most of these roles skip a live interview and gate access through an automated assessment or qualification task instead, though some do add an interview step, so don't assume either way until you check the application flow.
What does Software Engineering work look like for a Repo-based Code Annotator?
Tasks here are scoped to Software Engineering, not generic labeling. As a Repo-based Code Annotator, expect to draw on real domain judgment (evaluating outputs, correcting errors, or providing expert reasoning specific to Software Engineering) rather than following a one-size-fits-all rubric. If you don't have hands-on Software Engineering background, this is likely not the right listing to start with.
What happens when I click Apply on this listing?
You'll be taken to Rex's external site to complete your application there. This listing links through a referral, but the process is identical to applying directly; the link just routes you correctly. Create an account on their site and follow their onboarding steps.
Who is behind Remo Experts (Rex)?
Rex is the contractor brand of Remo, a remote work infrastructure company, acting as employer of record for AI training contracts on behalf of large AI labs and data companies. Your contract is formally with Remo, not the end client.