Skip to content
Domain expertsFreelanceNot in Africa

Physician (MD/DO) – Medical AI Evaluation

On Mindrift, run by Toloka

Rate not listed

Physicians grade the written patient cases in a medical AI benchmark, judging each case, the answer offered for it and the reasoning in between. The posting is for doctors with an active, unrestricted US medical license who are based in eligible US states, so it does not appear to be open to people living in Nigeria, Kenya, Ghana, South Africa or Egypt.

Opens the listing on jobs.workable.com. ASV earns nothing from this link. Disclosure

Pay

Rate not listed

Paid only for approved tasks, at a fixed rate for each task type that is set in advance; the listing gives no figure. QA and adjudication tasks pay more, there is a one-time $50 reward once your first task is approved, and high-quality work can earn extra.

Type
Freelance
Hours
Self-scheduled, with no minimum hours or required availability; the amount of work varies with the project's phase
Africa
Not in Africa
Platform
Mindrift
Posted
Nov 6, 2026

01 · The role

What you would do

  • Assess written cases drawn from health records, each with a question, a proposed answer and a planted wrong answer
  • Score each case on its accuracy and completeness, on whether it gives the answer away, and on how well both answers are built
  • Check that the answer can be reached from the case facts alone, fix faulty reasoning and give a short rationale for each score
  • Review cases blind as one of three physicians, before a physician adjudicates

02 · Requirements

What they ask for

  • An MD or DO and an active US medical license with no restrictions, verified when you join and rechecked each month
  • A completed residency or board certification, plus direct patient care experience; attending-level doctors are preferred, and practicing or retired physicians are welcome
  • Diagnostic and treatment experience across many body systems, as in internal, family, emergency or hospital medicine
  • Strong clinical reasoning: differential diagnosis, choosing next steps and applying evidence-based guidelines
  • Written English at C1 level or above

Helpful, not required

  • Earlier work evaluating medical AI, reviewing clinical content or exam questions, or annotating and checking medical data
  • Internal medicine
  • Clinical reasoning
  • Differential diagnosis
  • Medical AI evaluation

03 · Eligibility

Who can apply

Remote. Workable files this posting under South Africa, but its text limits the project to US-licensed physicians based in eligible US states, so none of the five countries is treated as eligible.

Countries named in the listing: United States.

Not in Africa

  • NigeriaCannot apply
  • KenyaCannot apply
  • GhanaCannot apply
  • South AfricaCannot apply
  • EgyptCannot apply

That is as far as the listing and Mindrift's country rules show: the listing has the last word, and rules change. Mindrift in Africa

Apply from where you live, as yourself. Using a VPN or someone else's identity to get around a country rule breaks these platforms' terms, and it is the quickest way to lose an account and any unpaid earnings.

04 · Applying

How to get in

You apply through Mindrift's own process. The steps from sign-up to first paid task are on its profile.

05 · Source

About this listing

We last confirmed this opening on Nov 7, 2026, and it was posted on Nov 6, 2026. Rates and hours come from the listing unless the note beside the rate says otherwise. Where the listing names no countries, the Africa status is our reading of it and of what is known of Mindrift's country rules, set out on its profile, and never marks a role more open than they show. The listing itself has the final word.

The listing on jobs.workable.com(opens in a new tab)

More open roles like this.

All openings

The platform

Mindrift

Toloka

Toloka's project-based platform for experts and writers who train AI.

VariesSelectiveGeneralist, Software & code, Math & science, Languages, Domain experts

Mindrift

Ready to apply? Read the listing first.

Check the rate, the hours and who can apply against the listing, follow the platform's own steps, and keep a second application going.

Physician (MD/DO) – Medical AI Evaluation

Rate not listed

Apply(opens in a new tab)