Senior Machine Learning Engineer / Model Evaluations Expert
Ethos • Remote
Education
Not stated
Type
Hourly
Pay Rate
$125/hr
Listed
66d ago
Apply opens Ethos in a new tab.
Apply Now → ⚡ Boost your chances - Optimize your resume with Rezi.aiAbout this role
From the Ethos listing
Ethos pays $125/hour for this Senior ML Engineer opening, one of the higher STEM rates on the platform, and wants 5+ years specifically in model evaluation or applied ML, distinct from general software engineering. The work is building and applying evaluation methodology and benchmarking to a foundation model's own outputs, a step removed from training models and closer to auditing them. It suits someone who has designed real ML evaluation systems, beyond using off-the-shelf metrics.
Requirements
- Must be eligible to work in Remote
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
- Bachelor's degree or equivalent professional experience
- Demonstrated expertise in Software Engineering
How long hiring takes
Across the AI training platforms we refer candidates to, the median gap between referral and hire is about 30 days. It varies by platform and role, so treat it as a rough guide for this one.
Why this role
$125/hr for Senior Machine Learning Engineer / Model Evaluations Expert work puts your Software Engineering expertise on the same footing as an AI lab's own research staff, without the overhead of running a consulting practice around it.
Skills and categories
Explore other opportunities in related specializations:
Related jobs
Browse All Jobs from Ethos
Discover more opportunities on Ethos that match your skills and interests.
View All Ethos Jobs →Verified Reviews
Community Reviews
Share your experience with Ethos
Help other candidates make better decisions by leaving a review.
Sign in to leave a reviewLeave your review
Common questions
Do I need to keep applying for projects on Ethos?
No. Once your profile is live, Ethos's algorithm matches you to inbound opportunities based on your career history, so companies find you instead of you hunting for listings. Your Expert Score rises with each completed engagement and unlocks higher-value work over time. Ethos already works with 25+ private equity firms, hedge funds, and consultancies, so the deal flow behind this is real.
How and when does Ethos pay experts?
Within 30 days of invoice submission after a project closes. That net-30 schedule is standard for enterprise expert networks, but it's slower than the weekly payouts some AI training platforms offer, so plan your cash flow around it.
What does the day-to-day workload look like for elite-expert AI training roles?
Slow and deep, not fast and repetitive. A single task can take 45-60 minutes of researching citations or verifying complex calculations. Quality is what's being measured here, not throughput.
Is AI training work the same as traditional consulting?
No. Instead of client deliverables, you're given complex scenarios to evaluate: grading the AI's logic, correcting its hallucinations, and supplying expert-level reasoning it doesn't have on its own. The job is closer to teaching than consulting.
What does Software Engineering work look like for a Senior Machine Learning Engineer / Model Evaluations Expert?
Tasks here are scoped to Software Engineering, not generic labeling. As a Senior Machine Learning Engineer / Model Evaluations Expert, expect to draw on real domain judgment (evaluating outputs, correcting errors, or providing expert reasoning specific to Software Engineering) rather than following a one-size-fits-all rubric. If you don't have hands-on Software Engineering background, this is likely not the right listing to start with.
What specific skills does this listing call for?
Expert is named directly in the listing. If you don't have hands-on experience with this, expect the screening process to test for it directly rather than accepting adjacent experience as a substitute.
How much does this specific role pay?
This listing is posted at $125/hr, an hourly rate. Pay can change between when we last checked the listing and when you apply, so confirm the current number on the platform's own application page before committing time.
What happens when I click Apply on this listing?
You'll be taken to Ethos's external site to complete your application there. This listing links through a referral, but the process is identical to applying directly; the link just routes you correctly. Create an account on their site and follow their onboarding steps.
Who built Ethos and is it legitimate?
Yes, it's legitimate and well-funded: Ethos raised $3.5M from General Catalyst and was co-founded by Daniel Mankowitz (Google DeepMind research scientist and lead author of AlphaDev) and James Lo (McKinsey, SoftBank Vision Fund). Over 17,000 experts have signed up, and it's actively working with 25+ PE firms, hedge funds, and consultancies. The referral link on this page is an affiliate link; it doesn't affect your pay or opportunities.