Code-Data Eval Author — Software Engineer (Pilot)
Mercor • Remote • Posted 0 days ago
Education
Any
Type
Pay Rate
$77.5/task
Posted
0d ago
✅ Applying through this link gives you a verified candidate referral.
Referrals from verified candidates give your profile a visibility boost and help support our platform at no cost to you.
This position is hosted on an external talent platform. Please only apply for this position if it fits your skills and interests.
Applying to Mercor?
We support strong candidates applying here. Set up your talent profile so we know who you are.
Set up your profile →About this Role
Code-Data Eval Author — Software Engineer (Mercor · remote contract)
Mercor partners with frontier AI labs to build the evaluations their coding models are trained and measured against. As an eval author you'll write real engineering tasks, golden solutions, and test verifiers, and grade AI-agent work — you define what "correct" means for the next generation of coding models.
Location Requirements
Code-Data Eval Author — Software Engineer
What you'll do
You are
Engagement & pay
Hiring process — paid
Code-Data Eval Author — Software Engineer (Mercor · remote contract) Mercor partners with frontier AI labs to build the evaluations their coding models are trained and measured against. As an eval author you'll write real engineering tasks, golden solutions, and test verifiers, and grade AI-agent work — you define what "correct" means for the next generation of coding models. What you'll do Author non-trivial coding tasks with golden solutions and automated verifiers Design rubrics and grade agent trajectories / model outputs Improve task and rubric quality through structured review ~5+ years of software engineering at a real product organization (big tech or venture-backed startup) Strong code quality, systems design, debugging, and testing discipline Clear written communication (you write instructions others follow) Familiarity with AI coding tools / evals is a plus, not a requirement Engagement & pay Remote contract, flexible 30+ hrs/week Hourly rate set to your local market (e.g., US/Canada $90–120/hr; Europe and LatAm scaled to region) Hiring process — paid A short Mercor Technical Screen, a live Code Review Session, and a Domain Expert Interview. You're paid $200 for completing all three, regardless of outcome. We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
- Author non-trivial coding tasks with golden solutions and automated verifiers
- Design rubrics and grade agent trajectories / model outputs
- Improve task and rubric quality through structured review
- ~5+ years of software engineering at a real product organization (big tech or venture-backed startup)
- Strong code quality, systems design, debugging, and testing discipline
- Clear written communication (you write instructions others follow)
- Familiarity with AI coding tools / evals is a plus, not a requirement
- Remote contract, flexible 30+ hrs/week
- Hourly rate set to your local market (e.g., US/Canada $90–120/hr; Europe and LatAm scaled to region)
Requirements
- Must be eligible to work in Remote
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
- Bachelor's degree or equivalent professional experience
- Demonstrated expertise in Software Engineering
Compensation Analysis
Work from anywhere, at any time. This fully remote position ($77.5/hr) breaks down geographic barriers, allowing you to earn US-competitive rates regardless of your local market. It is a perfect stepping stone for building a career in the data labeling and AI training ecosystem.
Skills & Categories
Explore other opportunities in related specializations:
Related Jobs
Document Annotation Specialist (PDF)
sme_careers • Software Engineering
$10
iOS Engineer (Swift and Objective-C)
sme_careers • Software Engineering
$110
Android Engineer (Kotlin and Java)
sme_careers • Software Engineering
$110
Full Stack Engineer (Node.js and React)
sme_careers • Software Engineering
$100
Browse All Jobs from Mercor
Discover more opportunities on Mercor that match your skills and interests.
View All Mercor Jobs →Community Reviews
Share your experience with Mercor
Help other candidates make better decisions by leaving a review.
Sign in to leave a reviewLeave your review
Frequently Asked Questions
Is this for freelancers or full-time employees?
Both. Mercor tries to match you with clients who want long-term contractors. Unlike other platforms where you log in and grab small tasks, Mercor matches you with one company for a steady role (e.g., 'Python Tutor for 3 months').
I'm not comfortable on camera. Can I still apply?
No. The application requires a video interview with an AI avatar. The AI asks you questions about your resume, and the video is shared with potential clients to prove your communication skills.
Does it cost money to join?
No. You should never pay to join these platforms. Mercor makes money by charging the client a fee on top of your hourly rate.
What does the work actually look like?
It is practical, hands-on data work. You might be recording short videos, categorizing images, rating text responses, or analyzing data. The tasks are designed to be short and distinct—typically 5-60 minutes per task.
How flexible is the schedule?
Extremely. This is true "log in and work" flexibility. You can usually work for 20 minutes or 4 hours depending on your availability. There are rarely minimum hour requirements, making it ideal for side income.
Is there an interview?
Usually, no. Hiring for these roles is almost entirely based on passing an automated assessment or "qualification" task. If you pass the test, you get access to the work.
How soon will I start?
Important: Mercor is a talent marketplace, not a task queue. Applying puts you in a pool of candidates. You will only start working when a specific client (like a major AI lab) selects your profile. This matching process can take weeks.