Older listing: position may have been filled
This listing is no longer actively promoted, but you're still welcome to apply. Platforms often reopen roles or keep applications on file.
Data Scientist – AI Training & Evaluation
Alignerr • Remote
Education
Any
Type
Pay Rate (by country)
$25–$40/task
Listed
116d ago
✅ Applying through this link supports our platform at no cost to you.
This position is hosted on an external talent platform. Please only apply for this position if it fits your skills and interests.
About this Role
From the Alignerr listing
What You'll Do
- Evaluate AI model outputs for accuracy, reasoning quality, and statistical soundness
- Design and apply data-driven evaluation criteria and scoring rubrics
- Analyze patterns in AI-generated responses to identify systematic errors or biases
- Create high-quality training data — including prompts, solutions, and annotations — in your areas of expertise
- Provide structured, detailed feedback to improve model performance across data science and analytical tasks
- Review AI-generated code, visualizations, and statistical analyses for correctness
- Work independently and asynchronously on your own schedule
About the Role
AI is only as smart as the experts who train it — and that's where you come in. We're looking for data scientists to evaluate, improve, and help shape the next generation of AI systems. Your expertise in statistics, machine learning, and data analysis will directly influence how AI models reason, respond, and perform across complex analytical tasks. This is a fully remote, flexible contract role that lets you contribute to cutting-edge AI research on your own schedule.
- Organization: Alignerr
- Type: Hourly Contract
- Location: Remote
- Commitment: 10–40 hours/week
Who You Are
- Degree in Data Science, Statistics, Computer Science, Mathematics, or a related quantitative field (MS or PhD preferred)
- Strong foundation in statistics, probability, and machine learning concepts
- Proficient in Python, R, SQL, or similar data analysis tools
- Experienced with data wrangling, exploratory data analysis, and model evaluation
- Excellent analytical thinking with sharp attention to detail
- Strong written communication in English — able to explain complex concepts clearly and simply
- Self-motivated and comfortable working independently in an async environment
Nice to Have
- Experience with deep learning frameworks such as PyTorch or TensorFlow
- Familiarity with NLP, large language models (LLMs), or AI evaluation workflows
- Published research or industry experience in applied machine learning
- Background in A/B testing, causal inference, or experimental design
Why Join Us
- Work on cutting-edge AI projects alongside top research labs and AI teams globally
- Gain rare, hands-on insight into how state-of-the-art LLMs are trained and evaluated
- Fully remote and flexible — work when and where it suits you
- Freelance autonomy with access to meaningful, intellectually stimulating work
- Be part of a growing community of expert contributors making AI smarter and more reliable
- Potential for ongoing work and long-term contract extension
Requirements
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
Eligible Languages
Fluent proficiency in English
Why This Role
AI is only as smart as the experts who train it — and that's where you come in. We're looking for data scientists to evaluate, improve, and help shape the next generation of AI systems. Your expertise in statistics, machine learning, and data analysis will directly influence how AI models reason, respond, and perform across complex analytical tasks
Skills & Categories
Explore other opportunities in related specializations:
Related Jobs
Browse All Jobs from Alignerr
Discover more opportunities on Alignerr that match your skills and interests.
View All Alignerr Jobs →Verified Reviews
Community Reviews
Share your experience with Alignerr
Help other candidates make better decisions by leaving a review.
Sign in to leave a reviewLeave your review
Frequently Asked Questions
How hard is the Alignerr assessment?
Hard, and unforgiving. Alignerr uses TestGorilla for timed, role-specific tests: a blank coding environment for engineers, strict grammar and fact-checking for writers. Treat it as one shot. Failing or abandoning it typically locks you out of that role permanently, with no retake.
How soon can I start earning on Alignerr after passing the assessment?
Not right away. After passing, you still complete identity verification through Persona and billing setup through Deel, then wait in a pool for weeks or months. You only start earning once a project matching your specific skills launches and assigns you. Don't count on Alignerr income until you're actively placed on a project.
Does Alignerr have a trainer community?
Yes, and it's a genuine strength. Once you're assigned to a project, you join Slack channels where you can get rubric clarifications from admins and talk to other trainers. That kind of support is rare in AI training and matters most when guidelines are ambiguous or shift mid-project.
What does task-based AI training work actually look like?
Practical, hands-on data work: recording short videos, categorizing images, rating text responses, or analyzing data. Tasks are designed to be short and distinct, typically 5 to 60 minutes each.
What does asynchronous AI training work mean in practice?
No set hours, no check-ins, no meetings. You log in when you want, pick up an available task, complete it, and submit; nobody is waiting on you in real time. That's different from remote employment, where you're expected online during business hours. The tradeoff: you're competing with others for available tasks, so an empty queue means there's simply nothing to do until more work is released.
What does Data Science work look like for a Data Scientist – AI Training & Evaluation?
Tasks here are scoped to Data Science, not generic labeling. As a Data Scientist – AI Training & Evaluation, expect to draw on real domain judgment (evaluating outputs, correcting errors, or providing expert reasoning specific to Data Science) rather than following a one-size-fits-all rubric. If you don't have hands-on Data Science background, this is likely not the right listing to start with.
Do I need to be fluent in English?
Yes. This role specifically requires English proficiency. You will likely be evaluated on written fluency during the assessment, not just conversational level. If English is not your first language or you are not professionally fluent, this is not the right role. Filter for your native language to find better-matched listings.
What happens when I click Apply on this listing?
You'll be taken to Alignerr's external site to complete your application there. This listing links through a referral, but the process is identical to applying directly; the link just routes you correctly. Create an account on their site and follow their onboarding steps.
What is the barrier to entry for Alignerr?
A difficult, timed technical assessment in your specific domain, like Python, physics, or language. Passing it is required before you're eligible for any paid projects.