Medical Expert – AI Evaluation

Mercor is seeking highly qualified Medical Experts with strong clinical knowledge and excellent analytical skills to support a high-impact AI research initiative in partnership with a leading AI lab. In this role, you will evaluate and audit AI-generated medical outputs across a wide range of clinical and scientific tasks, ensuring accuracy, safety, and adherence to medical standards.


Key Responsibilities

  • Review and audit AI-generated medical content, including clinical explanations, differential diagnoses, treatment recommendations, research summaries, and patient-facing materials.
  • Evaluate medical text quality using structured rubrics (8–10 criteria), focusing on accuracy, evidence alignment, clarity, and risk/safety considerations.
  • Verify correctness of clinical reasoning, identifying logical gaps, unsafe recommendations, or unsupported claims.
  • Assess adherence to medical guidelines, best practices, and standard terminology.
  • Identify errors related to medical facts, pathophysiology, pharmacology, contraindications, or misinterpretation of clinical data.
  • Provide clear, concise written feedback to justify evaluation decisions.
  • Work independently and asynchronously using provided tools and workflows.

Qualifications

  • Advanced medical training (MD, DO, RN, PA, NP, clinical researcher, or equivalent background).
  • Strong understanding of clinical reasoning, diagnostic process, and evidence-based practice.
  • Experience in one or more of the following:
    • Clinical writing or reviewing
    • Medical education or exam preparation content
    • Research interpretation and summarization
    • Healthcare quality review or medical annotation tasks
  • Exceptional attention to detail and ability to follow complex guidelines.
  • Ability to work independently in a remote environment.

Role Details

  • Part-time: 30–40 hours per week
  • Fully remote and asynchronous
  • Flexible scheduling

Compensation

  • Contractor role via Mercor
  • $80–$100/hour, depending on experience
  • Weekly payments through Stripe Connect