A new study published in Nature Medicine reveals that AI chatbots are not only effective at diagnosing diseases but can also provide nuanced guidance for treatment decisions. Doctors who take advantage of this tech outperform doctors who only have access to internet searches and medical references. The research, led by Dr. Jonathan Chen and his team, focused on testing how chatbots handle complex clinical management reasoning questions, such as determining appropriate pre-surgery protocols or adjusting treatment plans based on patient history.
Interestingly, while chatbots alone performed well, doctors who worked with chatbot assistance achieved comparable results to the chatbots, suggesting a powerful synergy between human and artificial intelligence in medical decision-making. The study involved testing three groups—a chatbot alone, doctors with chatbot support, and doctors with only internet access—across five de-identified patient cases, with responses evaluated against a rubric created by board-certified physicians.
While these results are promising, Dr. Chen emphasizes that patients should not bypass doctors in favor of chatbots, stressing the continued importance of human medical professionals in discerning credible information and making final treatment decisions.
Image credit: Pongsak Sapakdee / iStock