AI Training Scenario Designer
Mercor • Remote • Posted 19 days ago
Education
Any
Type
Pay Rate
$75/task
Posted
19d ago
✅ Applying through this link gives you a verified candidate referral.
Referrals from verified candidates give your profile a visibility boost and help support our platform at no cost to you.
This position is hosted on an external talent platform. Please only apply for this position if it fits your skills and interests.
About this Role
About the Role We're looking for creative, detail-oriented experts to help train the next generation of AI agents. You'll design realistic, complex digital worlds and craft challenging scenarios that test how well AI navigates real-world tasks — think scheduling conflicts, information overload, competing priorities, and more. What You'll Do
Build richly detailed personas and simulated digital environments (Gmail, Slack, Calendar, WhatsApp, Google Drive, and more)
About the Role
What You'll Do
You're a Good Fit If You
Must Have
Nice to have
Writing chops
Multi-stakeholder coordination
World-building / creative design
Technical / data comfort
About the Role We're looking for creative, detail-oriented experts to help train the next generation of AI agents. You'll design realistic, complex digital worlds and craft challenging scenarios that test how well AI navigates real-world tasks — think scheduling conflicts, information overload, competing priorities, and more. What You'll Do Build richly detailed personas and simulated digital environments (Gmail, Slack, Calendar, WhatsApp, Google Drive, and more) Write tasks that challenge an AI agent's ability to reason, filter, and prioritize Run the agent against your scenarios, evaluate its performance, and guide it to success through structured hints Document your work clearly in Airtable and Crucible You're a Good Fit If You Have strong written communication and attention to detail Think creatively and enjoy constructing layered, realistic scenarios Are comfortable working with structured tools like JSON editors, Airtable, and AI platforms Can spot inconsistencies and think critically about information quality Work independently and manage your own workflow Must Have - Undergrad degree, 2+ years professional experience. Nice to have: Writing chops — copywriter, UX writer, journalist, content strategist, editor, published blog/newsletter, creative writing background. Strong writers make the best task creators and reviewers Multi-stakeholder coordination — PM, account manager, consultant, client success, event coordinator, producer. Creates richer, more authentic professional scenarios World-building / creative design — game designer, curriculum designer, UX researcher, simulation designer, tabletop RPG creator Technical / data comfort — JSON familiarity, Jira/Asana power user, technical PM, data analyst, SQL/Python exposure. A plus but not required — we'll provide a JSON onboarding guid We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
- Build richly detailed personas and simulated digital environments (Gmail, Slack, Calendar, WhatsApp, Google Drive, and more)
- Write tasks that challenge an AI agent's ability to reason, filter, and prioritize
- Run the agent against your scenarios, evaluate its performance, and guide it to success through structured hints
- Document your work clearly in Airtable and Crucible
- Have strong written communication and attention to detail
- Think creatively and enjoy constructing layered, realistic scenarios
- Are comfortable working with structured tools like JSON editors, Airtable, and AI platforms
- Can spot inconsistencies and think critically about information quality
- Work independently and manage your own workflow
- Must Have - Undergrad degree, 2+ years professional experience.
- Nice to have:
Writing chops — copywriter, UX writer, journalist, content strategist, editor, published blog/newsletter, creative writing background. Strong writers make the best task creators and reviewers
Multi-stakeholder coordination — PM, account manager, consultant, client success, event coordinator, producer. Creates richer, more authentic professional scenarios
World-building / creative design — game designer, curriculum designer, UX researcher, simulation designer, tabletop RPG creator
Technical / data comfort — JSON familiarity, Jira/Asana power user, technical PM, data analyst, SQL/Python exposure. A plus but not required — we'll provide a JSON onboarding guid
- Writing chops — copywriter, UX writer, journalist, content strategist, editor, published blog/newsletter, creative writing background. Strong writers make the best task creators and reviewers
- Multi-stakeholder coordination — PM, account manager, consultant, client success, event coordinator, producer. Creates richer, more authentic professional scenarios
- World-building / creative design — game designer, curriculum designer, UX researcher, simulation designer, tabletop RPG creator
- Technical / data comfort — JSON familiarity, Jira/Asana power user, technical PM, data analyst, SQL/Python exposure. A plus but not required — we'll provide a JSON onboarding guid
- Writing chops — copywriter, UX writer, journalist, content strategist, editor, published blog/newsletter, creative writing background. Strong writers make the best task creators and reviewers
- Multi-stakeholder coordination — PM, account manager, consultant, client success, event coordinator, producer. Creates richer, more authentic professional scenarios
- World-building / creative design — game designer, curriculum designer, UX researcher, simulation designer, tabletop RPG creator
- Technical / data comfort — JSON familiarity, Jira/Asana power user, technical PM, data analyst, SQL/Python exposure. A plus but not required — we'll provide a JSON onboarding guid
Requirements
- Must be eligible to work in Remote
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
- Bachelor's degree or equivalent professional experience
- Demonstrated expertise in Data Science
Compensation Analysis
Work from anywhere, at any time. This fully remote position ($75/hr) breaks down geographic barriers, allowing you to earn US-competitive rates regardless of your local market. It is a perfect stepping stone for building a career in the data labeling and AI training ecosystem.
Skills & Categories
Explore other opportunities in related specializations:
Related Jobs
Browse All Jobs from Mercor
Discover more opportunities on Mercor that match your skills and interests.
View All Mercor Jobs →Community Reviews
Leave your review
Frequently Asked Questions
Is this for freelancers or full-time employees?
Both. Mercor tries to match you with clients who want long-term contractors. Unlike other platforms where you log in and grab small tasks, Mercor matches you with one company for a steady role (e.g., 'Python Tutor for 3 months').
I'm not comfortable on camera. Can I still apply?
No. The application requires a video interview with an AI avatar. The AI asks you questions about your resume, and the video is shared with potential clients to prove your communication skills.
Does it cost money to join?
No. You should never pay to join these platforms. Mercor makes money by charging the client a fee on top of your hourly rate.
What does the work actually look like?
It is practical, hands-on data work. You might be recording short videos, categorizing images, rating text responses, or analyzing data. The tasks are designed to be short and distinct—typically 5-60 minutes per task.
How flexible is the schedule?
Extremely. This is true "log in and work" flexibility. You can usually work for 20 minutes or 4 hours depending on your availability. There are rarely minimum hour requirements, making it ideal for side income.
Is there an interview?
Usually, no. Hiring for these roles is almost entirely based on passing an automated assessment or "qualification" task. If you pass the test, you get access to the work.
How soon will I start?
Important: Mercor is a talent marketplace, not a task queue. Applying puts you in a pool of candidates. You will only start working when a specific client (like a major AI lab) selects your profile. This matching process can take weeks.