Skip to content
Domain expertsFreelanceSome African countries

Physician (MD/DO) – Medical AI Evaluation

On Mindrift, run by Toloka

$35/hr

Physicians check a medical AI benchmark by grading written patient cases, the answers proposed for them and the reasoning that links the two. It is meant for practicing doctors who live outside the US and hold a full, active US medical license; students, unlicensed graduates and other clinicians such as nurses or pharmacists cannot take part.

Opens the listing on jobs.workable.com. ASV earns nothing from this link. Disclosure

Pay

$35/hr

About $35 an hour equivalent: each approved task pays one flat rate, set from its estimated time. QA and adjudication tasks pay more, a one-time $50 reward follows your first approved production task, and high-quality work can earn extra.

Type
Freelance
Hours
Project-based; an estimated 10–20 hours a week while the project is active, at times you choose; not a minimum or a guarantee
Africa
Some countries
Platform
Mindrift
Posted
Nov 3, 2026

01 · The role

What you would do

  • Read patient cases built from health records, each paired with a question, a proposed answer and a planted wrong answer
  • Rate each case on accuracy and completeness, on whether it hints at the answer, and on the quality of both answers
  • Confirm the answer follows from the case facts alone, correct flawed reasoning and justify each rating briefly
  • Review each case blind as one of three physicians, with a further physician resolving differences

02 · Requirements

What they ask for

  • An MD or DO with an active US medical license free of restrictions, checked at onboarding and monthly after that
  • Board certification or a completed residency, with recent direct patient care; attending-level doctors are preferred
  • Diagnosis and treatment experience across many body systems, for example in internal, family, emergency or hospital medicine
  • Strong clinical reasoning, including differential diagnosis, next-step management and evidence-based guidelines
  • Written English at C1 or higher

Helpful, not required

  • Past work evaluating medical AI, reviewing clinical content or exam items, or annotating and quality-checking medical data
  • Internal medicine
  • Clinical reasoning
  • Differential diagnosis
  • Medical AI evaluation

03 · Eligibility

Who can apply

Remote, posted for South Africa. It is for physicians living outside the US who hold an active, unrestricted US medical license.

Countries named in the listing: South Africa.

Some African countries

  • NigeriaCannot apply
  • KenyaCannot apply
  • GhanaCannot apply
  • South AfricaCan apply
  • EgyptCannot apply

That is as far as the listing and Mindrift's country rules show: the listing has the last word, and rules change. Mindrift in Africa

Apply from where you live, as yourself. Using a VPN or someone else's identity to get around a country rule breaks these platforms' terms, and it is the quickest way to lose an account and any unpaid earnings.

04 · Applying

How to get in

You apply through Mindrift's own process. The steps from sign-up to first paid task are on its profile.

05 · Source

About this listing

We last confirmed this opening on Nov 4, 2026, and it was posted on Nov 3, 2026. Rates and hours come from the listing unless the note beside the rate says otherwise. Where the listing names no countries, the Africa status is our reading of it and of what is known of Mindrift's country rules, set out on its profile, and never marks a role more open than they show. The listing itself has the final word.

The listing on jobs.workable.com(opens in a new tab)

More open roles like this.

All openings

The platform

Mindrift

Toloka

Toloka's project-based platform for experts and writers who train AI.

VariesSelectiveGeneralist, Software & code, Math & science, Languages, Domain experts

Mindrift

Ready to apply? Read the listing first.

Check the rate, the hours and who can apply against the listing, follow the platform's own steps, and keep a second application going.

Physician (MD/DO) – Medical AI Evaluation

$35/hr

Apply(opens in a new tab)