NEJM Group Experts Discuss Rigorous Evaluation Methods for Medical AI

In a 44-minute NEJM Group expert discussion, clinical scientist Xiao Liu of Microsoft AI and Swiss ophthalmologist Livia Faes, who co-authored a systematic review of deep learning systems, discussed how to evaluate medical AI rigorously. They argued for applying RCT reporting standards such as CONSORT to deep learning diagnostics and medical devices, with transparent methods. The talk drew on a 2019 Lancet Digital Health systematic review comparing deep learning with clinicians on medical imaging disease detection.