Pilot study reveals resident expertise improves diagnostic quality of ChatGPT-4 responses in internal medicine, suggesting need for better AI training.
Key Points
Residents significantly outperformed students in diagnostic quality, indicating expertise matters in AI interactions.
The odds ratio for residents compared to students was 2.33, highlighting a notable difference in performance.
Independent experts assessed the diagnostics of ChatGPT-4 based on concise summaries of complex clinical cases.
Optimising AI diagnostics involves enhancing user expertise and improving training strategies for better outcomes.