Retrospective study compares ChatGPT's diagnostic performance with neuroradiologists for CNS tumors, suggesting moderate efficacy and reliability in certain cases.
Key Points
ChatGPT achieved an accuracy of 48% in diagnosing central nervous system tumors, compared to 70% for the neuroradiologist.
The AI tool showed moderate agreement with the neuroradiologist and pathology results, with kappa values of 0.445 and 0.419, respectively.
The study involved 50 patients, analyzing MRI characteristics to generate differential diagnoses with ChatGPT's support.
ChatGPT performed better with common tumors like glioblastoma and meningioma but struggled with rarer cases, indicating limitations in its application.