Baseball Fan – Live MLB Game AI Evaluator (US)
Mercor • Remote, United States
Education
Not stated
Type
Hourly
Pay Rate
$100–$120/hr
Listed
1d ago
Apply opens Mercor in a new tab.
Apply Now → ⚡ Boost your chances - Optimize your resume with Rezi.aiAbout this role
From the Mercor listing
Role overview
Mercor is looking for US-based people with strong baseball knowledge to evaluate AI assistants live, while real MLB games are being played. On scheduled game days, you'll ask AI assistants the questions you'd naturally ask while following a game, then rate how helpful, accurate, and well-presented their answers are. Your judgments directly shape how AI products serve sports fans.
What you'll do
Follow live MLB postseason games and ask AI assistants real fan questions: live scores and win probability, player and team stats, rules and challenges, schedules and broadcasts, highlights, and expert-style analysis
Run the same question on two AI products side by side, either as a single question or as a multi-turn conversation of 2 to 10 turns
Capture share links and full screenshots of every conversation
Rate each response for helpfulness, factual accuracy, and presentation, choose which product did better, and write a clear rationale for your choice
What we're looking for
Based in the United States
At least 1 year of professional work experience
Solid baseball knowledge: rules, teams, players, and how the postseason works
Being an avid MLB fan or a general sports enthusiast is a plus
Available to work live during game windows on scheduled game days
Comfortable using AI chat assistants and web search
Strong written English, sharp attention to detail, and the ability to spot factual errors
Prior AI rating or evaluation experience is a plus, but not required
Details
Event-based: work happens on MLB postseason game days in October, from the Division Series through the World Series
Each task takes about 2 to 2.5 hours and is completed while the game is live
The first game day is as early as Saturday, October 3
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
How long hiring takes
Across the AI training platforms we refer candidates to, the median gap between referral and hire is about 30 days. It varies by platform and role, so treat it as a rough guide for this one.
Talent Pool members
Apply through this link and we can put you forward to Mercor when your profile is a strong match. Not every applicant is submitted. If you're not in the pool yet, set up your profile first.
Set up your profile →What to Expect
Looking at Mercor Generalist listings we've tracked, contracts in this domain typically run about 6.8 weeks. Actual length varies by project, but this gives you a realistic baseline going in.
Based on 10 extracted Mercor Generalist listings.
Why this role
This Baseball Fan – Live MLB Game AI Evaluator (US) role pays $100–$120/hr like specialized consulting, minus the client overhead. You set the hours, and the assignments draw directly on your Generalist background.
Skills and categories
Explore other opportunities in related specializations:
Related jobs
Browse All Jobs from Mercor
Discover more opportunities on Mercor that match your skills and interests.
View All Mercor Jobs →Verified Reviews
Community Reviews
Share your experience with Mercor
Help other candidates make better decisions by leaving a review.
Sign in to leave a reviewLeave your review
Common questions
Does Mercor's application require an on-camera interview?
Yes, every applicant records a video interview with an AI interviewer that asks questions about your resume. Clients review that recording to judge communication skills before matching, so there's no way to apply without going on camera.
Does it cost money to apply to Mercor?
No, applying and joining Mercor is free. Mercor's revenue comes from a fee it charges the client on top of your hourly rate, not from applicants. Treat any request for payment to join as a red flag.
What does the day-to-day workload look like for elite-expert AI training roles?
Slow and deep, not fast and repetitive. A single task can take 45-60 minutes of researching citations or verifying complex calculations. Quality is what's being measured here, not throughput.
Is AI training work the same as traditional consulting?
No. Instead of client deliverables, you're given complex scenarios to evaluate: grading the AI's logic, correcting its hallucinations, and supplying expert-level reasoning it doesn't have on its own. The job is closer to teaching than consulting.
What does Generalist work look like for a Baseball Fan – Live MLB Game AI Evaluator (US)?
Tasks here are scoped to Generalist, not generic labeling. As a Baseball Fan – Live MLB Game AI Evaluator (US), expect to draw on real domain judgment (evaluating outputs, correcting errors, or providing expert reasoning specific to Generalist) rather than following a one-size-fits-all rubric. If you don't have hands-on Generalist background, this is likely not the right listing to start with.
What specific skills does this listing call for?
English and Expert are named directly in the listing. If you don't have hands-on experience with these, expect the screening process to test for them directly rather than accepting adjacent experience as a substitute.
How much does this specific role pay?
This listing is posted at $100–$120/hr, an hourly rate. The range reflects experience level and negotiated terms, not a placeholder, so where you land in it depends on your background and the assessment. Pay can change between when we last checked the listing and when you apply, so confirm the current number on the platform's own application page before committing time.
What happens when I click Apply on this listing?
You'll be taken to Mercor's external site to complete your application there. This listing links through a referral, but the process is identical to applying directly; the link just routes you correctly. Create an account on their site and follow their onboarding steps.
Can I apply from outside the United States?
This specific role is open only to people based in the United States. If you are somewhere else, applying is unlikely to lead to an offer even if you pass the assessment, because the restriction is usually about where the work can legally be contracted rather than your skills. Read the full description for any tax-residency or right-to-work caveats before you apply.
How soon will I start working after applying to Mercor?
Not immediately. Mercor is a talent marketplace, not a task queue, so applying puts you in a pool of candidates. You start working only once a specific client, like a major AI lab, selects your profile, and that matching process can take weeks.