Role Description
In this hourly, remote contractor role, you will work as a Nurse Specialist and/or Nurse Practitioner (NP) Subject Matter Expert (SME) to review AI-generated clinical responses and/or create expert healthcare content, evaluating reasoning quality and step-by-step clinical problem-solving while providing precise written feedback. You will assess solutions for accuracy, clarity, safety, and adherence to the prompt; identify errors in advanced assessment, diagnosis/differential thinking, ordering/interpretation of tests, prescribing/medication management (where within scope), care pathway selection, and escalation/red-flag recognition; fact-check clinical information; write high-quality explanations and model solutions that demonstrate correct reasoning; and rate and compare multiple responses based on correctness and reasoning quality.
Nurse Practitioners and Specialist Nurses across a range of fields, including but not limited to Family NP (FNP), Adult-Gerontology NP (AGNP), Acute Care NP (ACNP), Pediatric NP (PNP), Psychiatric-Mental Health NP (PMHNP), Women’s Health NP (WHNP), Neonatal NP (NNP), Nurse Midwife (CNM), Oncology NP, Cardiology NP, Emergency/Trauma NP, ICU/Critical Care NP, Perioperative/OR, Wound Care, Diabetes Education, and Community/Public Health advanced practice are welcomed.
This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your healthcare expertise directly helps improve the world’s premier AI models by making their clinical and public-health reasoning more accurate, reliable, and clearly explained.
We onboard experts on a rolling basis. Project assignments depend on current client demand.
Your Profile
- NP / APRN (or equivalent advanced practice nursing qualification) with active licensure/registration (or eligibility) in at least one jurisdiction.
- 5+ years of nursing experience overall, including 2+ years in an advanced practice/specialist role (preferred).
- Strong advanced clinical reasoning: differential diagnosis, triage, red-flag recognition, and escalation aligned with your scope and setting.
- Experience managing common and complex conditions appropriate to your specialty, including follow-up planning, referrals, and patient education.
- Strong medication safety judgment, including contraindications, interactions (high level), renal/hepatic considerations (as relevant), and monitoring plans—within scope.
- Exceptional attention to detail when fact-checking and identifying unsafe assumptions, missing contraindications, inappropriate tests/therapies, or misinterpretation of results; minimum C1 English proficiency.
- Comfortable evaluating answers for internal consistency (timeline, physiology, dosing logic checks, guideline alignment), appropriateness for setting (ED vs inpatient vs outpatient), and patient-safety implications.
- Reliable, self-directed, and able to deliver consistent quality in an hourly, remote contractor workflow across time zones.
- Prior experience with AI data training/annotation, utilization review, clinical documentation review, guideline work, or healthcare editorial QA is strongly preferred.
Key Responsibilities
- Develop AI Training Content: Create detailed prompts and gold-standard answers aligned to your specialty (assessment, diagnosis, management, patient education, documentation).
- Optimize AI Performance: Evaluate and rank AI responses to improve correctness, safety, clarity, and contextual relevance.
- Ensure Model Integrity: Test AI outputs for inaccuracies, unsafe recommendations, and bias; validate reliability across patient populations and scenarios.
Skills
Risk Stratification, Advanced Clinical Assessment, Clinical Documentation, Evidence-Based Practice, Differential Diagnosis, Patient Safety, English, Care Pathways, Diagnostic Testing, Prescribing & Medication Management
Check your CV before you apply
Free, honest feedback on your CV for the Nurse Practitioner role. Takes about two minutes.