AI Training Scenario Designer
Mercor • Remote
Education
Any
Type
hourly
Pay Rate (by country)
$30–$80/hr
Listed
105d ago
✅ Applying through this link supports our platform at no cost to you.
This position is hosted on an external talent platform. Please only apply for this position if it fits your skills and interests.
In our Talent Pool?
Apply through this link and we can vouch for you to Mercor. ? We vouch for Talent Pool members who apply through our referral link, when we believe they're a strong match. Not every applicant gets a vouch. Not in the pool yet? Set up your profile first.
Set up your profile →Mercor: our referral track record
We've referred 191 candidates to Mercor roles. 14% (27) were placed.
About this Role
From the Mercor listing
About the Role We're looking for creative, detail-oriented experts to help train the next generation of AI agents. You'll design realistic, complex digital worlds and craft challenging scenarios that test how well AI navigates real-world tasks — think scheduling conflicts, information overload, competing priorities, and more. What You'll Do
- Build richly detailed personas and simulated digital environments (Gmail, Slack, Calendar, WhatsApp, Google Drive, and more)
- Write tasks that challenge an AI agent's ability to reason, filter, and prioritize
- Run the agent against your scenarios, evaluate its performance, and guide it to success through structured hints
- Document your work clearly in Airtable and Crucible
- Have strong written communication and attention to detail
- Think creatively and enjoy constructing layered, realistic scenarios
- Are comfortable working with structured tools like JSON editors, Airtable, and AI platforms
- Can spot inconsistencies and think critically about information quality
- Work independently and manage your own workflow
- Must Have - Undergrad degree, 2+ years professional experience.
- Nice to have:
- Writing chops — copywriter, UX writer, journalist, content strategist, editor, published blog/newsletter, creative writing background. Strong writers make the best task creators and reviewers
- Multi-stakeholder coordination — PM, account manager, consultant, client success, event coordinator, producer. Creates richer, more authentic professional scenarios
- World-building / creative design — game designer, curriculum designer, UX researcher, simulation designer, tabletop RPG creator
- Technical / data comfort — JSON familiarity, Jira/Asana power user, technical PM, data analyst, SQL/Python exposure. A plus but not required — we'll provide a JSON onboarding guid
Requirements
- Must be eligible to work in Remote
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
- Bachelor's degree or equivalent professional experience
- Demonstrated expertise in Data Science
Why This Role
Work from anywhere, at any time. This fully remote AI Training Scenario Designer position ($55/hr) breaks down geographic barriers, allowing you to earn US-competitive rates regardless of your local market. It is a perfect stepping stone for building a career in the Data Science ecosystem.
Skills & Categories
Explore other opportunities in related specializations:
Related Jobs
Browse All Jobs from Mercor
Discover more opportunities on Mercor that match your skills and interests.
View All Mercor Jobs →Verified Reviews
Community Reviews
Share your experience with Mercor
Help other candidates make better decisions by leaving a review.
Sign in to leave a reviewLeave your review
Frequently Asked Questions
Is Mercor for freelancers or full-time contractors?
Mercor places you with one client for a defined engagement, like 'Python Tutor for 3 months', rather than having you grab small tasks from a shared queue. Most roles function as steady contract work, not one-off gigs.
Does Mercor's application require an on-camera interview?
Yes, every applicant records a video interview with an AI interviewer that asks questions about your resume. Clients review that recording to judge communication skills before matching, so there's no way to apply without going on camera.
Does it cost money to apply to Mercor?
No, applying and joining Mercor is free. Mercor's revenue comes from a fee it charges the client on top of your hourly rate, not from applicants. Treat any request for payment to join as a red flag.
What does task-based AI training work actually look like?
Practical, hands-on data work: recording short videos, categorizing images, rating text responses, or analyzing data. Tasks are designed to be short and distinct, typically 5 to 60 minutes each.
What does asynchronous AI training work mean in practice?
No set hours, no check-ins, no meetings. You log in when you want, pick up an available task, complete it, and submit; nobody is waiting on you in real time. That's different from remote employment, where you're expected online during business hours. The tradeoff: you're competing with others for available tasks, so an empty queue means there's simply nothing to do until more work is released.
What does Data Science work look like for a AI Training Scenario Designer?
Tasks here are scoped to Data Science, not generic labeling. As a AI Training Scenario Designer, expect to draw on real domain judgment (evaluating outputs, correcting errors, or providing expert reasoning specific to Data Science) rather than following a one-size-fits-all rubric. If you don't have hands-on Data Science background, this is likely not the right listing to start with.
What happens when I click Apply on this listing?
You'll be taken to Mercor's external site to complete your application there. This listing links through a referral, but the process is identical to applying directly; the link just routes you correctly. Create an account on their site and follow their onboarding steps.
How soon will I start working after applying to Mercor?
Not immediately. Mercor is a talent marketplace, not a task queue, so applying puts you in a pool of candidates. You start working only once a specific client, like a major AI lab, selects your profile, and that matching process can take weeks.