Rigorous human review for frontier AI
StarAnnotation pairs verified subject-matter experts with the AI labs training the next generation of models. Earn up to $150/hr reviewing outputs in your field of depth.
4.8 average reviewer rating
Figure 1 — Maximum hourly rate by domain
Source: StarAnnotation platform rate schedule, current cohort. Rate reflects domain difficulty and reviewer qualification tier.
Methodology & standards
65,000+
Contributors
$52M+
Distributed
40+
Research domains
5
Countries
A four-stage review process
Every reviewer passes the same four stages before their first assignment, typically within 24 hours.
Submit your application
Create your account with email or Google. Add your profile, country, LinkedIn, and choose your expert categories.
Pass peer review
Take a short assessment in your chosen categories. Demonstrate your expertise and unlock the next step.
Verify credentials
Complete identity verification (KYC). Once approved, you get full access to the dashboard and paid tasks.
Begin reviewing
Complete annotation tasks at $40–$150/hr and withdraw your earnings directly to your crypto wallet.
Three review protocols
Every submission follows a documented protocol. Your domain depth decides which one applies.
Rate & rank AI answers
Rationale
Comparing model responses teaches the AI which answers are actually correct, helpful, and safe.
Protocol
Read a prompt and two or more model answers, then rank them and explain what makes the best one better.
Rank these responses
- Is the answer factually correct?
- Does it fully address the question?
- Is the reasoning sound, not just the result?
- Would an expert in the field approve it?
Built for rigor, not busywork
Every part of the process assumes your expertise is scarce, and prices it accordingly.
Compensated like expert consultation
Earn up to $150/hr. Review work in STEM, coding, and specialized domains is paid at a rate that reflects real expertise.
Self-directed review schedule
No shifts, no minimums, no assigned hours. Accept assignments whenever your schedule allows.
Transparent, documented process
Apply, pass peer review, verify credentials — most reviewers reach paid assignments within 24 hours.
Direct payouts
Withdraw earnings to your own wallet on Ethereum, Polygon, and more. Your balance is always visible.
Work that shapes real research
Your review directly informs model training data — proofs, code review, clinical judgment, legal reasoning.
Peer-reviewed panel
Every reviewer passes credential verification and identity check. You join 65,000+ verified contributors.
Current review studies
A snapshot of the studies currently open for qualified reviewers.
Choose your research domain
Compensation scales with difficulty — routine review at the low end, frontier reasoning at the top. Most reviewers specialize in 1–2 domains.
View all domains$60–$120/hr
Math
$75–$150/hr
Programming
$75–$150/hr
Medical
$75–$150/hr
Law
$75–$150/hr
Finance
$60–$120/hr
Physics
Found your domain? The peer-review assessment takes ~30 minutes — every submission is reviewed by hand.
Start your applicationIf you have expertise, there's a study for you
StarAnnotation is built for people with documented, credentialed depth in a subject. You bring the expertise; we bring the studies, the compensation, and the schedule.
- Based in the US, UK, CA, AU, or NZ
- An advanced degree or documented professional depth in your field
- Able to pass a peer-reviewed qualification assessment
Graduate researchers
Turn your published research and coursework depth into paid review work between projects.
Licensed domain professionals
Physicians, attorneys, and financial analysts apply credentialed judgment to review assignments.
Engineers & data scientists
Review model code and reasoning traces, and document errors, at rates above most freelance work.
Subject-matter specialists
Any field with genuine depth — linguistics, chemistry, and beyond — has an open study waiting.
Reviewers earn up to $150/hr
Reviewers with documented expertise clear thousands monthly. Compensation scales with credential tier and domain difficulty.
Six months of consistent, well-documented review work. The methodology is rigorous and the pay reflects it.
S. Karimi, M.S.
Mathematics & Physics — Reviewer
$12,400
As a working engineer, the code review assignments match my actual skill set. Compensation beats most consulting work.
J. Reyes
Computer Science — Reviewer
$18,200
The peer-review process was straightforward and well-documented. Within a week I was reviewing clinical data at top rates.
Dr. A. Lindqvist
Biology & Medicine — Reviewer
$9,800
Available balance
$3,420.00
Compensated for every review, in crypto
No invoicing, no institutional payment delays. Your balance updates as reviews are accepted.
01Compensated per assignment
Every completed review adds to your balance at up to $150/hr, based on domain and complexity.
02Transparent running balance
Your dashboard shows exactly what you've earned and what's available to withdraw, in real time.
03Withdraw on your schedule
Cash out to your wallet on Ethereum, USDC, or USDT once you clear the minimum threshold.
Frequently asked questions
We currently accept reviewers based in the United States, United Kingdom, Canada, Australia, and New Zealand. You must pass a peer-review qualification assessment in at least one domain and complete credential verification.
Hourly rates range up to $150 depending on domain and complexity. Specialized fields such as medicine and advanced mathematics compensate at the higher end.
After registering, you select your domains of expertise and complete a short assessment. On passing, you proceed to credential verification and gain access to review assignments.
We distribute compensation via crypto. Once your balance clears the minimum threshold, withdraw to your preferred wallet on Ethereum, Bitcoin, or USDT.
Most reviewers complete registration, qualification, and credential verification within 24 hours. Some complete it in under an hour.
Mathematics, coding, biology, finance, legal analysis, medicine, and more. Assignments are matched to your verified domain expertise.