Data Scientist – AI Training & Evaluation
Alignerr • Remote • Posted 23 days ago
Education
Any
Type
Pay Rate
$32.5/task
Posted
23d ago
✅ Applying through this link gives you a verified candidate referral.
Referrals from verified candidates give your profile a visibility boost and help support our platform at no cost to you.
This position is hosted on an external talent platform. Please only apply for this position if it fits your skills and interests.
About this Role
What You'll Do
- Evaluate AI model outputs for accuracy, reasoning quality, and statistical soundness
- Design and apply data-driven evaluation criteria and scoring rubrics
- Analyze patterns in AI-generated responses to identify systematic errors or biases
- Create high-quality training data — including prompts, solutions, and annotations — in your areas of expertise
- Provide structured, detailed feedback to improve model performance across data science and analytical tasks
- Review AI-generated code, visualizations, and statistical analyses for correctness
- Work independently and asynchronously on your own schedule
About the Role
AI is only as smart as the experts who train it — and that's where you come in. We're looking for data scientists to evaluate, improve, and help shape the next generation of AI systems. Your expertise in statistics, machine learning, and data analysis will directly influence how AI models reason, respond, and perform across complex analytical tasks. This is a fully remote, flexible contract role that lets you contribute to cutting-edge AI research on your own schedule.
- Organization: Alignerr
- Type: Hourly Contract
- Location: Remote
- Commitment: 10–40 hours/week
Who You Are
- Degree in Data Science, Statistics, Computer Science, Mathematics, or a related quantitative field (MS or PhD preferred)
- Strong foundation in statistics, probability, and machine learning concepts
- Proficient in Python, R, SQL, or similar data analysis tools
- Experienced with data wrangling, exploratory data analysis, and model evaluation
- Excellent analytical thinking with sharp attention to detail
- Strong written communication in English — able to explain complex concepts clearly and simply
- Self-motivated and comfortable working independently in an async environment
Nice to Have
- Experience with deep learning frameworks such as PyTorch or TensorFlow
- Familiarity with NLP, large language models (LLMs), or AI evaluation workflows
- Published research or industry experience in applied machine learning
- Background in A/B testing, causal inference, or experimental design
Why Join Us
- Work on cutting-edge AI projects alongside top research labs and AI teams globally
- Gain rare, hands-on insight into how state-of-the-art LLMs are trained and evaluated
- Fully remote and flexible — work when and where it suits you
- Freelance autonomy with access to meaningful, intellectually stimulating work
- Be part of a growing community of expert contributors making AI smarter and more reliable
- Potential for ongoing work and long-term contract extension
Requirements
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
Eligible Languages
Fluent proficiency in English
Compensation Analysis
AI is only as smart as the experts who train it — and that's where you come in. We're looking for data scientists to evaluate, improve, and help shape the next generation of AI systems. Your expertise in statistics, machine learning, and data analysis will directly influence how AI models reason, respond, and perform across complex analytical tasks
Skills & Categories
Explore other opportunities in related specializations:
Related Jobs
Browse All Jobs from Alignerr
Discover more opportunities on Alignerr that match your skills and interests.
View All Alignerr Jobs →Community Reviews
Leave your review
Frequently Asked Questions
What is the assessment actually like?
Notoriously strict. Alignerr uses TestGorilla for role-specific timed tests — a blank coding environment for engineers, rigorous grammar and fact-checking for writers. There is almost no hand-holding. The critical catch: this is essentially a one-shot process. Fail or abandon the assessment, and you are typically locked out of that role permanently with no option to retake.
How quickly can I start earning after I pass?
Not immediately. Even after passing the assessment and completing identity verification (via Persona) and billing setup (via Deel), you may sit in a waiting pool for weeks or months. You only start earning when a project matching your specific skills launches and you are officially assigned. Do not plan around Alignerr income until you are actively on a project.
Is there a community?
Yes — and it is one of Alignerr's genuine strengths. Once assigned to a project, you are added to Slack channels where you can ask questions, get rubric clarifications from admins, and talk to other AI trainers. This is rare in AI training and makes a real difference when guidelines are ambiguous or change mid-project.
What does the work actually look like?
It is practical, hands-on data work. You might be recording short videos, categorizing images, rating text responses, or analyzing data. The tasks are designed to be short and distinct—typically 5-60 minutes per task.
How flexible is the schedule?
Extremely. This is true "log in and work" flexibility. You can usually work for 20 minutes or 4 hours depending on your availability. There are rarely minimum hour requirements, making it ideal for side income.
Is there an interview?
Usually, no. Hiring for these roles is almost entirely based on passing an automated assessment or "qualification" task. If you pass the test, you get access to the work.
What is the barrier to entry?
Alignerr is known for difficult technical assessments. You must pass a timed test in your specific domain (e.g., Python, Physics, or Language) before you are eligible for any paid projects.