Grafana Expert (Software Engineer)
Mercor • Remote • Posted 33 days ago
Education
Any
Type
Pay Rate
$120/task
Posted
33d ago
✅ Applying through this link gives you a verified candidate referral.
Referrals from verified candidates give your profile a visibility boost and help support our platform at no cost to you.
This position is hosted on an external talent platform. Please only apply for this position if it fits your skills and interests.
About this Role
We're looking for experienced Grafana power users to design expert-level evaluation tasks that test whether AI agents can use Grafana the way a real professional does. Your domain expertise is what makes these tasks authentic.
What You'll Do
Overview
What You'll Do
to produce a reference trajectory
Requirements
Nice to Have
Time Commitment
We're looking for experienced Grafana power users to design expert-level evaluation tasks that test whether AI agents can use Grafana the way a real professional does. Your domain expertise is what makes these tasks authentic. What You'll Do Design realistic, multi-step Grafana workflows - dashboards, alerting rules, data source configuration, panel setup, cross-module operations Perform each workflow yourself on a hosted Grafana instance to produce a reference trajectory Write clear, specific task prompts with measurable outcomes that can be verified programmatically Implement programmatic graders that check whether each instruction was completed correctly Review AI agent attempts at your tasks, identify where and why they fail, and tag root causes Calibrate task difficulty so tasks are challenging but solvable - iterating on prompts and constraints based on model performance Requirements 2+ years of daily, professional Grafana experience (SRE, Platform Engineering, Observability, or similar) Deep familiarity with PromQL, dashboard templating, alerting pipelines, and data source configuration (Prometheus, InfluxDB, etc.) Ability to articulate workflows clearly enough for programmatic verification Comfort writing basic grading scripts (Python; engineering support provided as needed) Nice to Have Experience with Grafana API automation Kubernetes/infrastructure monitoring background Familiarity with AI evaluation or benchmarking Time Commitment 10-15 hrs/week minimum during the project Fast turnaround expected - responsiveness matters We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
- Design realistic, multi-step Grafana workflows - dashboards, alerting rules, data source configuration, panel setup, cross-module operations
- Perform each workflow yourself on a hosted Grafana instance
- Write clear, specific task prompts with measurable outcomes that can be verified programmatically
- Implement programmatic graders that check whether each instruction was completed correctly
- Review AI agent attempts at your tasks, identify where and why they fail, and tag root causes
- Calibrate task difficulty so tasks are challenging but solvable - iterating on prompts and constraints based on model performance
- 2+ years of daily, professional Grafana experience (SRE, Platform Engineering, Observability, or similar)
- Deep familiarity with PromQL, dashboard templating, alerting pipelines, and data source configuration (Prometheus, InfluxDB, etc.)
- Ability to articulate workflows clearly enough for programmatic verification
- Comfort writing basic grading scripts (Python; engineering support provided as needed)
- Experience with Grafana API automation
- Kubernetes/infrastructure monitoring background
- Familiarity with AI evaluation or benchmarking
- 10-15 hrs/week minimum during the project
- Fast turnaround expected - responsiveness matters
Requirements
- Must be eligible to work in Remote
- Fluent proficiency in English (Written & Verbal)
- Reliable high-speed internet connection
- Bachelor's degree or equivalent professional experience
- Demonstrated expertise in Software Engineering
Compensation Analysis
Shape the "brain" of future AI. By working as a Grafana Expert (Software Engineer), you ensure that future models understand the nuance of your field. At $120/hr, it's a lucrative way to preserve the integrity of your profession in the digital age.
Skills & Categories
Explore other opportunities in related specializations:
Related Jobs
Browse All Jobs from Mercor
Discover more opportunities on Mercor that match your skills and interests.
View All Mercor Jobs →Community Reviews
Leave your review
Frequently Asked Questions
Is this for freelancers or full-time employees?
Both. Mercor tries to match you with clients who want long-term contractors. Unlike other platforms where you log in and grab small tasks, Mercor matches you with one company for a steady role (e.g., 'Python Tutor for 3 months').
I'm not comfortable on camera. Can I still apply?
No. The application requires a video interview with an AI avatar. The AI asks you questions about your resume, and the video is shared with potential clients to prove your communication skills.
Does it cost money to join?
No. You should never pay to join these platforms. Mercor makes money by charging the client a fee on top of your hourly rate.
Is this traditional consulting?
Not exactly. You act as a "Teacher" for advanced AI. Instead of client deliverables, you are given complex scenarios to evaluate. You grade the AI's logic, correct its hallucinations, and provide expert-level reasoning. Your job is to train the model to think like you do.
Why is the pay so high?
This role requires deep, verified expertise. General knowledge isn't enough; the model is specifically being trained on "edge cases"—the rare, difficult, or highly technical nuances that only a senior professional would know.
What is the workload like?
This is cognitive, deep work. Unlike simple data labeling, you might spend 45-60 minutes on a single task, researching citations or verifying complex calculations. Quality is prioritized over speed.
How soon will I start?
Important: Mercor is a talent marketplace, not a task queue. Applying puts you in a pool of candidates. You will only start working when a specific client (like a major AI lab) selects your profile. This matching process can take weeks.