Software Engineer – AI Research & Evaluation (US-based)
Turing • Remote
Education
Any
Type
hourly
Pay Rate (by country)
$25–$55/hr
Listed
13d ago
✅ Applying through this link supports our platform at no cost to you.
This position is hosted on an external talent platform. Please only apply for this position if it fits your skills and interests.
Turing: our referral track record
We've referred 677 candidates to Turing roles. 2% (15) were placed.
Turing: typical time to hire
Based on 15 tracked placements across all Turing roles on our site.
What We Know About This Role
- Weekly hours
- 40 hrs/week
About this Role
From the Turing listing
About Turing: Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.
Role Overview
We are seeking a detail-oriented and analytically consistent Video Analyst / Annotator to evaluate and annotate visual content using structured guidelines, quality frameworks, and rating methodologies. The ideal candidate should demonstrate strong judgment, visual literacy, and the ability to make consistent evaluations across large volumes of content.
This role requires individuals who can assess visual and production quality factors such as realism, composition, motion quality, camera behavior, lighting, and overall content effectiveness while adhering strictly to annotation standards.
Job Responsibilities
Review and annotate video content based on defined guidelines and quality rubrics Evaluate content for realism, visual coherence, and production standards Provide structured ratings and written rationale where required Maintain annotation consistency and accuracy across tasks Identify visual defects, inconsistencies, or quality issues Collaborate with QA and project stakeholders to maintain evaluation standards Meet productivity and quality targets while ensuring guideline adherence
Job Requirements
Minimum 3 years of relevant professional experience Prior experience in media, creative agencies, production studios, or content evaluation environments strongly preferred Mandatory experience working directly as or closely with: Designers Photographers Videographers Creative production teams Experience with AI-generated video and image content evaluation is a strong advantage Familiarity with: Motion realism Camera movement and cinematography principles Lighting and visual aesthetics Production and editing quality assessment Strong analytical, logical reasoning, and research skills and excellent communication and collaboration abilities, with proficiency in English. Strong visual literacy, including understanding of: Realism and authenticity Composition and framing Motion and temporal consistency Quality differentiation across visual outputs Incorporate feedback from LLM performance metrics into training data creation. Ability to commit to 40 hours per week and candidates who can join immediately preferred.
Nice to have Qualification:
Bachelor’s degree or higher in:
Design, Visual Communication, or Fine Arts Film, Media, Animation, or VFX Photography or Cinematography Architecture or Industrial Design Creative Writing or equivalent professional experience in content creation, media production, or content review.
Benefits
Opportunity to work on cutting-edge AI projects. Competitive compensation. Flexible working hours and remote work environment.
Application Process
Shortlisted candidates will complete an assessment. Once the assessment is cleared, candidates can start.
Requirements
- Video
- Business Analysis
- Must be eligible to work in Remote
What to Expect
Looking at Turing Software Engineering listings we've tracked, contracts in this domain typically run about 9.8 weeks. Actual length varies by project, but this gives you a realistic baseline going in.
Based on 50 extracted Turing Software Engineering listings.
Eligible Languages
Fluent proficiency in English
Why This Role
Work from anywhere, at any time. This fully remote Software Engineer – AI Research & Evaluation (US-based) position ($40/hr) breaks down geographic barriers, allowing you to earn US-competitive rates regardless of your local market. It is a perfect stepping stone for building a career in the Software Engineering ecosystem.
Skills & Categories
Explore other opportunities in related specializations:
Related Jobs
Engineering & Data tools Specialist
micro1 • Software Engineering
$80 /hr
QA / Software Engineering Reviewer – Browser Test Validation
mercor • Software Engineering
$60 /hr
Head of AI & Engineering Expert
ethos • Software Engineering
$150 /hr
Senior Machine Learning Engineer / Model Evaluations Expert
ethos • Software Engineering
$125 /hr
Browse All Jobs from Turing
Discover more opportunities on Turing that match your skills and interests.
View All Turing Jobs →Verified Reviews
Community Reviews
Share your experience with Turing
Help other candidates make better decisions by leaving a review.
Sign in to leave a reviewLeave your review
Frequently Asked Questions
Do I need to be a software engineer to work for Turing?
No, not anymore. Turing built its name matching senior engineers with Silicon Valley companies, but it has since expanded into AGI infrastructure work and now hires non-engineering domain experts, technical writers, and researchers for post-training data annotation and RLHF. A strong analytical background and excellent English matter more than coding ability.
How does Turing's talent matching work?
Turing calls it the Intelligent Talent Cloud. You build a profile and go through vetting (automated tests, an AI-powered interview, practical skill assessments), and once vetted, Turing's algorithm surfaces your profile directly to partner companies like Fortune 500s and top AI labs. You don't browse listings or bid on work; matches come to you.
How and when does Turing pay contractors?
Monthly, in USD, via Deel, Payoneer, or direct bank transfer. You're engaged as an independent contractor responsible for your own local taxes. Plan your cash flow around a monthly cycle if you're used to weekly payouts elsewhere.
What does task-based AI training work actually look like?
Practical, hands-on data work: recording short videos, categorizing images, rating text responses, or analyzing data. Tasks are designed to be short and distinct, typically 5 to 60 minutes each.
What does asynchronous AI training work mean in practice?
No set hours, no check-ins, no meetings. You log in when you want, pick up an available task, complete it, and submit; nobody is waiting on you in real time. That's different from remote employment, where you're expected online during business hours. The tradeoff: you're competing with others for available tasks, so an empty queue means there's simply nothing to do until more work is released.
What does Software Engineering work look like for a Software Engineer – AI Research & Evaluation (US-based)?
Tasks here are scoped to Software Engineering, not generic labeling. As a Software Engineer – AI Research & Evaluation (US-based), expect to draw on real domain judgment (evaluating outputs, correcting errors, or providing expert reasoning specific to Software Engineering) rather than following a one-size-fits-all rubric. If you don't have hands-on Software Engineering background, this is likely not the right listing to start with.
How many hours per week does this role require?
Based on the listing, this role is scoped at about 40 hours per week. Treat this as a real commitment expectation, not a loose estimate.
Do I need to be fluent in English?
Yes. This role specifically requires English proficiency. You will likely be evaluated on written fluency during the assessment, not just conversational level. If English is not your first language or you are not professionally fluent, this is not the right role. Filter for your native language to find better-matched listings.
What happens when I click Apply on this listing?
You'll be taken to Turing's external site to complete your application there. This listing links through a referral, but the process is identical to applying directly; the link just routes you correctly. Create an account on their site and follow their onboarding steps.