[About the Role]We are assembling a network of experienced healthcare professionals and clinical researchers to help train and evaluate advanced AI systems used in medicine and public health. In this role, you will apply your clinical, research, or diagnostic expertise to review AI-generated content, design realistic medical scenarios, and define rigorous evaluation standards that reflect real-world practice and patient safety.
This is a flexible, remote freelance opportunity that can be done alongside your existing clinical, academic, or research commitments.
After you apply, we will match you to a track based on your background, such as:• Clinical Care (physicians, nurses, PAs, APPs, pharmacists, therapists, etc.)• Imaging Diagnostics (pathology, radiology, cardiology)•Clinical Research Public Health•Medical Residents (PGY3+ and above)•ML / AI Research (for candidates with strong ML research credentials)
[What You’ll Do]As a Medical Clinical Expert – AI Trainer, you will:
Core responsibilities (across all tracks)• Review and assess AI-generated medical responses, clinical reasoning, and recommendations for accuracy, safety, and adherence to best practices.• Develop and refine clinical scenarios, case vignettes, and training datasets that reflect real-world patient care and healthcare workflows.• Identify and correct inaccuracies, safety risks, biases, and gaps in AI outputs, proposing clear, actionable improvements.• Provide structured, written feedback and rubrics to evaluate AI performance, reasoning quality, and communication.• Ensure that all content aligns with ethical, regulatory, and clinical standards, supporting responsible innovation in healthcare AI.• Collaborate with AI, product, and research teams to refine guidelines, quality bars, and evaluation processes.
Depending on your track, you may also:
Clinical Frontline Care• Evaluate AI support for diagnosis, treatment planning, triage, and patient communication.• Review sample notes, discharge summaries, orders, or care plans for clinical quality.
Imaging Diagnostic Specialties (Pathology, Radiology, Cardiology)• Review and validate medical data or imaging-related annotations and diagnostic descriptions.• Provide domain expertise to improve diagnostic accuracy and reduce clinically unsafe model behavior.• Help design or review training materials and QA workflows for labeling teams.
Clinical Research Public Health• Design, review, and optimize study protocols, research questions, and public health scenarios for AI training.• Evaluate and annotate clinical and population health datasets, ensuring statistical and methodological rigor.• Ensure alignment with GCP, IRB/ethics, informed consent, and public health regulations.
Medical Residents (PGY3+)• Create diagnostic cases and scoring rubrics that reflect residency-level reasoning and workups.• Stress-test AI systems on nuanced, real-world clinical cases and edge conditions.
ML / AI Research Track (optional subset)• Translate external ML competitions and benchmarks into tasks that reflect real-world healthcare responsibilities.• Validate implementations and evaluation setups and document discrepancies or limitations.