Repo-based Code Annotator
Remo Experts • Remote
Education
Not stated
Type
Hourly
Pay Rate
$80/hr
Listed
194d ago
Apply opens Remo Experts in a new tab.
Apply Now → ⚡ Boost your chances - Optimize your resume with Rezi.aiAbout this role
From the Remo Experts listing
Build reproducible, standardized test environments using Docker images to accurately replicate known issues or generate expected outputs according to specified procedures.
Review and enhance the coverage and effectiveness of existing unit tests to assess the correctness and stability of target code.
Validate the completeness and rationality of test sets, ensuring that workflows for tasks related to SWE-Bench and Terminal-Bench are precisely aligned.
Write high-quality task documentation (task.yaml/README), emphasizing reproducibility and standardized processes.
Requirements
- Must be eligible to work in Remote
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
- Bachelor's degree or equivalent professional experience
- Demonstrated expertise in Software Engineering
Why this role
This Repo-based Code Annotator role runs entirely remote at $80/hr, so your location stops being a factor in whether you can do Software Engineering work for an AI lab.
Skills and categories
Explore other opportunities in related specializations:
Related jobs
Browse All Jobs from Remo Experts
Discover more opportunities on Remo Experts that match your skills and interests.
View All Remo Experts Jobs →Verified Reviews
Community Reviews
Share your experience with Remo Experts
Help other candidates make better decisions by leaving a review.
Sign in to leave a reviewLeave your review
Common questions
What is Rex's Superhuman Profile?
It's Rex's reputation system: a running score of your reliability, consistency, and task quality. A stronger profile unlocks higher-paying tracks and priority access to premium projects like Project EVA (with 2077AI), so every task you complete affects what you get offered next.
What kind of tasks does Rex assign?
RLHF and instruction-tuning dataset creation, LLM prompt and response evaluation, named entity recognition, computer vision annotation, content safety labeling, speech-to-text transcription, and red-teaming and safety evaluations. Your specific assignment depends on your skills and profile tier.
Do task-based AI training roles require an interview?
Most skip a live interview entirely and gate access through an automated assessment or qualification task instead. Where we've confirmed the specific requirement for this listing, it's called out above in What We Know About This Role.
What does task-based AI training work look like?
Practical, hands-on data work: recording short videos, categorizing images, rating text responses, or analyzing data. Tasks are designed to be short and distinct, typically 5 to 60 minutes each.
What does Software Engineering work look like for a Repo-based Code Annotator?
Tasks here are scoped to Software Engineering, not generic labeling. As a Repo-based Code Annotator, expect to draw on real domain judgment (evaluating outputs, correcting errors, or providing expert reasoning specific to Software Engineering) rather than following a one-size-fits-all rubric. If you don't have hands-on Software Engineering background, this is likely not the right listing to start with.
What specific skills does this listing call for?
Data Annotation and Entry Level are named directly in the listing. If you don't have hands-on experience with these, expect the screening process to test for them directly rather than accepting adjacent experience as a substitute.
How much does this specific role pay?
This listing is posted at $80/hr, an hourly rate. Pay can change between when we last checked the listing and when you apply, so confirm the current number on the platform's own application page before committing time.
What happens when I click Apply on this listing?
You'll be taken to Rex's external site to complete your application there. This listing links through a referral, but the process is identical to applying directly; the link just routes you correctly. Create an account on their site and follow their onboarding steps.
Who is behind Remo Experts (Rex)?
Rex is the contractor brand of Remo, a remote work infrastructure company, acting as employer of record for AI training contracts on behalf of large AI labs and data companies. Your contract is formally with Remo, not the end client.