aitrainer.work - AI Training Jobs Platform
Generalist mercor

Cloud Storage Management Expert

Mercor Remote Posted 4 days ago

Education

Any

Type

Pay Rate

$52.5/task

Posted

4d ago

✅ Applying through this link gives you a verified candidate referral.

Referrals from verified candidates give your profile a visibility boost and help support our platform at no cost to you.

This position is hosted on an external talent platform. Please only apply for this position if it fits your skills and interests.

Apply Now

About this Role

We are seeking an Cloud Storage Management Expert to perform human-in-the-loop testing and evaluation of agentic storage management experiences. This role supports the calibration and validation of AI-powered storage agents by providing expert, manual evaluation of user journeys that complement existing LLM-based evaluation pipelines. As a Storage Management Evaluation Specialist, you will manually evaluate AI agent responses across end-to-end storage management workflows using natural language interfaces. Your storage administration expertise will be essential for assessing the completeness, accuracy, and practical value of agent-generated recommendations from an industry practitioner's perspective.

This is a W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading technology company as part of their extended workforce.

Location Requirements

Overview

Cloud Storage Management Expert

W-2 employment position

Responsibilities

Discovery Evaluation

Planning Evaluation

Validation Evaluation

Execution Evaluation

Reporting Evaluation

Traffic Simulation

Agent Invocation & Feedback

Scoring Calibration

3P Agent Testing

Deliverables

Required Qualifications

Storage administration experience

data migration

practitioner's perspective

natural language interfaces

Preferred Qualifications

storage performance analysis

QA, evaluation, or red-teaming

About Cincinnatus LLC

Equal Employment Opportunity

We are seeking an Cloud Storage Management Expert to perform human-in-the-loop testing and evaluation of agentic storage management experiences. This role supports the calibration and validation of AI-powered storage agents by providing expert, manual evaluation of user journeys that complement existing LLM-based evaluation pipelines. As a Storage Management Evaluation Specialist, you will manually evaluate AI agent responses across end-to-end storage management workflows using natural language interfaces. Your storage administration expertise will be essential for assessing the completeness, accuracy, and practical value of agent-generated recommendations from an industry practitioner's perspective. This is a W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading technology company as part of their extended workforce. Discovery Evaluation: Test User Journeys across migration options to calibrate agent response completeness and accuracy of presented options. Planning Evaluation: Assess agent guidance on trade-offs between Online and Offline transfer methods, including Cloud Interconnect ROI analysis and time estimates across varying file sizes and object counts. Validation Evaluation: Execute simulation and dry-run migration User Journeys; identify issues that could cause migration failures. Execution Evaluation: Initiate actual transfer operations via agent interfaces and assess operational reliability. Reporting Evaluation: Evaluate agent-generated progress tracking, outcome reporting, and variance analysis against migration plans. Traffic Simulation: Simulate realistic storage traffic in test projects to create representative evaluation conditions. Agent Invocation & Feedback: Invoke AI Agents with natural language queries and provide subjective, expert-level feedback on outcomes. Scoring Calibration: Calibrate offline scoring mechanisms using evaluation findings to improve automated assessment accuracy. 3P Agent Testing: Test third-party agent blueprints built for customers on the Cloud Storage MCP platform. Completed User Journey evaluation reports for each agent (per 10-week cycle) Documented subjective insights and actionable feedback on agent responses from a storage admin persona Calibration data and recommendations for the offline scoring mechanism Issue logs identifying agent failure modes, inaccuracies, or gaps Summary reports comparing agent-planned outcomes vs. actual migration results Storage administration experience with a strong understanding of cloud storage concepts, data migration strategies, and enterprise storage management practices Familiarity with cloud storage platforms (AWS S3, GCS, Azure) Hands-on experience with data migration — including online/offline transfer methods, Cloud Interconnect, and transfer sizing considerations Ability to evaluate AI/LLM-generated recommendations from a practitioner's perspective, identifying gaps in completeness and accuracy Strong written communication skills for documenting evaluation findings and providing structured feedback Comfortable working with natural language interfaces and conversational AI tools Background in storage performance analysis, security auditing, or storage intelligence/analytics Prior experience in QA, evaluation, or red-teaming of AI/ML systems Familiarity with MCP (Model Context Protocol) or agentic AI frameworks Cincinnatus LLC is an enterprise staffing company that partners with leading technology companies to source and employ highly skilled professionals for contingent and contract-based opportunities. Cincinnatus serves as the employer of record for these engagements, providing W-2 employment, payroll, benefits, and compliance, while placing employees directly within client teams to work on high-impact initiatives. Roles hired through Cincinnatus are not project-based or freelance engagements. They are structured, role-based positions that typically involve part-time or full-time commitments, close collaboration with a client's internal teams, and integration into standard enterprise workflows. Cincinnatus is a legal entity separate from Mercor. While opportunities may be discovered through Mercor's platform, employment, onboarding, payroll, and benefits for these roles are administered by Cincinnatus LLC. Cincinnatus is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic. Cincinnatus is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans throughout the job application process. We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

  • Discovery Evaluation: Test User Journeys across migration options to calibrate agent response completeness and accuracy of presented options.
  • Planning Evaluation: Assess agent guidance on trade-offs between Online and Offline transfer methods, including Cloud Interconnect ROI analysis and time estimates across varying file sizes and object counts.
  • Validation Evaluation: Execute simulation and dry-run migration User Journeys; identify issues that could cause migration failures.
  • Execution Evaluation: Initiate actual transfer operations via agent interfaces and assess operational reliability.
  • Reporting Evaluation: Evaluate agent-generated progress tracking, outcome reporting, and variance analysis against migration plans.
  • Traffic Simulation: Simulate realistic storage traffic in test projects to create representative evaluation conditions.
  • Agent Invocation & Feedback: Invoke AI Agents with natural language queries and provide subjective, expert-level feedback on outcomes.
  • Scoring Calibration: Calibrate offline scoring mechanisms using evaluation findings to improve automated assessment accuracy.
  • 3P Agent Testing: Test third-party agent blueprints built for customers on the Cloud Storage MCP platform.
  • Completed User Journey evaluation reports for each agent (per 10-week cycle)
  • Documented subjective insights and actionable feedback on agent responses from a storage admin persona
  • Calibration data and recommendations for the offline scoring mechanism
  • Issue logs identifying agent failure modes, inaccuracies, or gaps
  • Summary reports comparing agent-planned outcomes vs. actual migration results
  • Storage administration experience with a strong understanding of cloud storage concepts, data migration strategies, and enterprise storage management practices
  • Familiarity with cloud storage platforms (AWS S3, GCS, Azure)
  • Hands-on experience with data migration — including online/offline transfer methods, Cloud Interconnect, and transfer sizing considerations
  • Ability to evaluate AI/LLM-generated recommendations from a practitioner's perspective, identifying gaps in completeness and accuracy
  • Strong written communication skills for documenting evaluation findings and providing structured feedback
  • Comfortable working with natural language interfaces and conversational AI tools
  • Background in storage performance analysis, security auditing, or storage intelligence/analytics
  • Prior experience in QA, evaluation, or red-teaming of AI/ML systems
  • Familiarity with MCP (Model Context Protocol) or agentic AI frameworks

Requirements

  • Must be eligible to work in Remote
  • Fluent proficiency in English (Written & Verbal)
  • Reliable high-speed internet connection
  • Bachelor's degree or equivalent professional experience
  • Demonstrated expertise in Generalist

Compensation Analysis

Rare opportunity for top 1% experts. Earn $52.5/hr contributing to the world's most advanced AI labs. This is one of the few roles where academic precision is valued as highly as commercial output.

Skills & Categories

Explore other opportunities in related specializations:

Generalist Expert AI Training

Related Jobs

Mercor

Browse All Jobs from Mercor

Discover more opportunities on Mercor that match your skills and interests.

View All Mercor Jobs →

Community Reviews

Loading reviews…

Frequently Asked Questions

Is this for freelancers or full-time employees?

Both. Mercor tries to match you with clients who want long-term contractors. Unlike other platforms where you log in and grab small tasks, Mercor matches you with one company for a steady role (e.g., 'Python Tutor for 3 months').

I'm not comfortable on camera. Can I still apply?

No. The application requires a video interview with an AI avatar. The AI asks you questions about your resume, and the video is shared with potential clients to prove your communication skills.

Does it cost money to join?

No. You should never pay to join these platforms. Mercor makes money by charging the client a fee on top of your hourly rate.

What does the work actually look like?

It is practical, hands-on data work. You might be recording short videos, categorizing images, rating text responses, or analyzing data. The tasks are designed to be short and distinct—typically 5-60 minutes per task.

How flexible is the schedule?

Extremely. This is true "log in and work" flexibility. You can usually work for 20 minutes or 4 hours depending on your availability. There are rarely minimum hour requirements, making it ideal for side income.

Is there an interview?

Usually, no. Hiring for these roles is almost entirely based on passing an automated assessment or "qualification" task. If you pass the test, you get access to the work.

How soon will I start?

Important: Mercor is a talent marketplace, not a task queue. Applying puts you in a pool of candidates. You will only start working when a specific client (like a major AI lab) selects your profile. This matching process can take weeks.