Content Analyst
Turing • Remote, The United States, India, Bangladesh, Egypt, Kenya, Mexico, Nigeria, Pakistan, Turkey • Posted 28 days ago
Education
Any
Type
Pay Rate
$55/task
Posted
28d ago
✅ Applying through this link gives you a verified candidate referral.
Referrals from verified candidates give your profile a visibility boost and help support our platform at no cost to you.
This position is hosted on an external talent platform. Please only apply for this position if it fits your skills and interests.
About this Role
About the projects
we are building LLM evaluation and training datasets to train LLM to work on realistic software engineering problems. One of our approaches, in this project, is to build verifiable SWE tasks based on public repository histories in a synthetic approach with human-in-the-loop; while expanding the dataset coverage to different types of tasks in terms of programming language, difficulty level, and etc.
About the Role
We are looking for experienced software engineers (tech lead level) who are familiar with high-quality public GitHub repositories and can contribute to this project. This role involves hands-on software engineering work, including development environment automation, issue triaging, and evaluating test coverage and quality
Why Join Us?
Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems. You’ll be at the forefront of evaluating how LLMs interact with real code, influencing the future of AI-assisted software development. This is a unique opportunity to blend practical software engineering with AI research.
What does day-to-day look like
: • Analyze and triage GitHub issues across trending open-source libraries. • Set up and configure code repositories, including Dockerization and environment setup. • Evaluating unit test coverage and quality. • Modify and run codebases locally to assess LLM performance in bug-fixing scenarios. • Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs. • Opportunities to lead a team of junior engineers to collaborate on projects.
Required Skills
• Minimum 3+ years of overall experience • Strong experience with at least one of the following languages: Ruby • Proficiency with Git, Docker, and basic software pipeline setup. • Ability to understand and navigate complex codebases. • Comfortable running, modifying, and testing real-world projects locally. • Experience contributing to or evaluating open-source projects is a plus.
Nice to Have
• Previous participation in LLM research or evaluation projects. • Experience building or testing developer tools or automation agents.
Perks of Freelancing With Turing
• Work in a fully remote environment. • Opportunity to work on cutting-edge AI projects with leading LLM companies.
Offer Details
•
Commitments Required
: At least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST. (We have 3 options of time commitment: 20 hrs/week, 30 hrs/week or 40 hrs/week) •
Employment type
: Contractor assignment (no medical/paid leave) •
Location
: India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, Mexico
Evaluation Process (approximately 75 mins)
• Two rounds of interviews (60 min technical + 30 min technical & cultural discussion)
Requirements
- Must be eligible to work in one of: Remote, The United States, India, etc.
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
- Bachelor's degree or equivalent professional experience
- Demonstrated expertise in Software Engineering
Compensation Analysis
we are building LLM evaluation and training datasets to train LLM to work on realistic software engineering problems. One of our approaches, in this project, is to build verifiable SWE tasks based on public repository histories in a synthetic approach with human-in-the-loop; while expanding the dataset coverage to different types of tasks in terms
Skills & Categories
Explore other opportunities in related specializations:
Related Jobs
Browse All Jobs from Turing
Discover more opportunities on Turing that match your skills and interests.
View All Turing Jobs →Community Reviews
Leave your review
Frequently Asked Questions
Do I need to be a software engineer?
Not anymore. Turing built its reputation matching senior engineers with Silicon Valley companies, but they have heavily pivoted into AGI infrastructure. They now hire non-engineering domain experts, technical writers, and researchers for post-training data annotation and RLHF. A strong analytical background and excellent English are required, but you do not need to code.
How does matching work?
Turing calls it the 'Intelligent Talent Cloud.' You build a profile and go through deep vetting — automated tests, an AI-powered interview, and practical skill assessments. Once vetted, Turing's algorithm automatically surfaces you to partner companies (Fortune 500s and top AI labs). You don't browse job boards or bid on work — matches come to you.
How does payment work?
You are hired as an independent contractor, responsible for your own local taxes. Turing collects payment from the client and pays you monthly in USD via Deel, Payoneer, or direct bank/wire transfer. Monthly pay is standard for long-term contract roles — if you need weekly cash flow, this structure requires adjustment.
What does the work actually look like?
It is practical, hands-on data work. You might be recording short videos, categorizing images, rating text responses, or analyzing data. The tasks are designed to be short and distinct—typically 5-60 minutes per task.
How flexible is the schedule?
Extremely. This is true "log in and work" flexibility. You can usually work for 20 minutes or 4 hours depending on your availability. There are rarely minimum hour requirements, making it ideal for side income.
Is there an interview?
Usually, no. Hiring for these roles is almost entirely based on passing an automated assessment or "qualification" task. If you pass the test, you get access to the work.