Senior Machine Learning Engineer / Model Evaluations Expert

No. Ethos is an expert network, not a task queue. AI labs, investment funds, and Fortune 500s pay to access your specific domain knowledge (deal analysis, clinical reasoning, legal logic, financial modeling) through three formats: multi-week consulting engagements, 30-60 minute advisory calls, and targeted research surveys.

No. Once your profile is live, Ethos's algorithm matches you to inbound opportunities based on your career history, so companies find you instead of you hunting for listings. Your Expert Score rises with each completed engagement and unlocks higher-value work over time. Ethos already works with 25+ private equity firms, hedge funds, and consultancies, so the deal flow behind this is real.

Within 30 days of invoice submission after a project closes. That net-30 schedule is standard for enterprise expert networks, but it's slower than the weekly payouts some AI training platforms offer, so plan your cash flow around it.

No. Instead of client deliverables, you're given complex scenarios to evaluate: grading the AI's logic, correcting its hallucinations, and supplying expert-level reasoning it doesn't have on its own. The job is closer to teaching than consulting.

Because general knowledge isn't what's being tested. The model already knows the basics; what it needs is expertise on edge cases, the rare, difficult, highly technical judgment calls only a senior professional in the field would make correctly.

Slow and deep, not fast and repetitive. A single task can take 45-60 minutes of researching citations or verifying complex calculations. Quality is what's being measured here, not throughput.

Tasks here are scoped to Software Engineering, not generic labeling. As a Senior Machine Learning Engineer / Model Evaluations Expert, expect to draw on real domain judgment (evaluating outputs, correcting errors, or providing expert reasoning specific to Software Engineering) rather than following a one-size-fits-all rubric. If you don't have hands-on Software Engineering background, this is likely not the right listing to start with.

You'll be taken to Ethos's external site to complete your application there. This listing links through a referral, but the process is identical to applying directly; the link just routes you correctly. Create an account on their site and follow their onboarding steps.

This specific role is restricted to USA. If you are outside these locations, applying is unlikely to result in an offer even if you pass the assessment. Check the full job description for any VPN or tax-residency caveats.

Yes, it's legitimate and well-funded: Ethos raised $3.5M from General Catalyst and was co-founded by Daniel Mankowitz (Google DeepMind research scientist and lead author of AlphaDev) and James Lo (McKinsey, SoftBank Vision Fund). Over 17,000 experts have signed up, and it's actively working with 25+ PE firms, hedge funds, and consultancies. The referral link on this page is an affiliate link; it doesn't affect your pay or opportunities.