Senior Software Code Reviewer
vetto β’ Remote β’ Posted 33 days ago
Education
Any
Type
Pay Rate
$75/task
Posted
33d ago
About this Role
About Vetto
Vetto is a tech company focused on building and scaling high-quality datasets for artificial intelligence systems. We work at the intersection of human expertise and AI, ensuring that models are trained on technically accurate, well-defined, and realistic data. Our projects support the training and evaluation of Large Language Models (LLMs), where technical rigor and correctness are non-negotiable.
About the Project
This project focuses on the technical review and validation of coding tasks used to train AI models. Coding challenges are generated automatically by AI, and your role is to evaluate quality of the challenge. The core questions you will be answering on every task: Are the requirements well defined? Are the associated tests correctly validating the requirements? Tests are treated as the mechanism of truth in this context. Mistakes here propagate at scale into AI systems β error criticality is high.
Languages
Tasks in this project involve code written across multiple languages. You will be expected to review and evaluate tasks in any of the following: Python JavaScript / TypeScript Go Rust Java
Responsibilities
Evaluate whether the coding task itself is clearly and correctly defined Validate whether tests accurately reflect whether the problem has been solved Determine whether a solution that passes the tests genuinely solves the underlying problem Apply strict technical criteria and quality standards consistently across tasks
Required Profile
This role is designed for mid/senior-level software engineers with real professional experience. Technical requirements Proven professional experience in software development (production environments) Experience reviewing and evaluating code written by other engineers Solid understanding of automated testing β how tests validate (or fail to validate) behavior Experience contributing to or working with open source projects High attention to detail and strong technical judgment Comfortable working fully in English (reading and writing) Nice to have Experience with test-driven development (TDD) or test design Familiarity with large or complex codebases
Project Details
This is expert, task-based technical work focused on analysis, validation, and judgment β not code production. Each task takes approximately 30 minutes. Tasks are reviewed under continuous QA and calibration. Compensation is in the range of $100 per hour (task-equivalent reference), varying based on task complexity and approved volume.
Selection Process
The selection process is fully asynchronous and consists of two phases: Phase 1 β Application Submit your profile through the application form. We evaluate candidates based on their professional background, open source contributions, and screening responses. There are no interviews. Phase 2 β Technical Exercise Shortlisted candidates will receive a short technical exercise consisting of real coding tasks in the languages they selected. The exercise simulates the actual work: you will review generated code and assess whether it correctly solves the problem and whether the associated tests are valid. Performance on this exercise is the primary selection criterion. Candidates who pass both phases will be onboarded directly into the project.
This role is not about writing more code. It is about technical judgment, rigor, and responsibility. If you are comfortable challenging problem definitions, questioning tests that "pass but are wrong", and acting as a technical quality gate β this project is for you.
Requirements
- Must be eligible to work in Remote
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
- Bachelor's degree or equivalent professional experience
- Demonstrated expertise in STEM
Eligible Languages
Fluent proficiency in English
Compensation Analysis
Vetto is a tech company focused on building and scaling high-quality datasets for artificial intelligence systems. We work at the intersection of human expertise and AI, ensuring that models are trained on technically accurate, well-defined, and realistic data. Our projects support the training and evaluation of Large Language Models (LLMs), where
Skills & Categories
Explore other opportunities in related specializations:
Related Jobs
Browse All Jobs from vetto
Discover more opportunities on vetto that match your skills and interests.
View All vetto Jobs βCommunity Reviews
Leave your review
Frequently Asked Questions
How do I get started?
Review the hiring process above and follow the steps outlined. Each platform has different requirements, so make sure you meet the eligibility criteria before applying.
Is this work legitimate?
Yes. All platforms listed on aitrainer.work are legitimate and pay reliably. However, always verify payment methods and read reviews before committing significant time.
Is this just labeling data?
No. This is closer to academic research. You will likely be writing or verifying complex proofs, solving advanced equations, or checking the logic of a model's step-by-step reasoning. The goal is to teach AI systems to reason deeply in your field.
Do I need a PhD?
For the highest pay tiers in this category, a PhD (or current enrollment) is usually expected. However, the most important factor is your ability to pass the domain assessment. If you can solve the problems, the degree is secondary.
Is the work continuous?
Work in niche fields is often project-based. A specific "campaign" (e.g., training a model on Quantum Mechanics) might last for a few weeks. It is best to treat this as a high-paying fellowship or grant rather than a permanent daily job.