Large language models are not fit for clinical practice … and other research

LLMs not fit to practiseReviewing 360° assessment feedback from colleagues can be nerve wracking, particularly if you had to ask someone who you know doesn’t think much of your clinical skills (or just doesn’t like you) in order to get the required number of feedback forms. If large language model (LLM) AI diagnosticians had to be revalidated they’d probably be fine, as they’d have no shortage of clinicians from frothy start-ups hoping to become the next health tech unicorn willing to give it positive feedback. However, if they asked the authors of a new diagnostic accuracy study in Nature Medicine, they might find themselves in trouble. These authors conclude that “current state-of-the-art LLMs do not accurately diagnose patients across all pathologies (performing significantly worse than physicians), follow neither diagnostic nor treatment guidelines, and cannot interpret laboratory results, thus posing a serious risk to the health of patients.” Not only are…
Read Original Article: Large language models are not fit for clinical practice … and other research »