Home >  Medicine MDTV >  Medicine Shorts >  Study Warns Against Use...

Study Warns Against Use of AI Chatbots for Drug Information

By - Dr. Bhumika Maikhuri
Published On 2024-10-14 03:00 GMT   |   Update On 2024-10-14 03:00 GMT
Advertisement
Artificial Intelligence (AI) powered search engines and chatbots may not always provide accurate and safe information on drugs, and patients shouldn’t rely on these, warned a study. Researchers from Belgium and Germany conducted the study after finding many answers were wrong or potentially harmful.
In the paper, published in the journal BMJ Quality and Safety, they said that the complexity of the answers provided by the AI chatbot may be difficult to understand and might require degree-level education.
With the introduction of AI-powered chatbots search engines in 2023 underwent a significant shift. The renewed versions offered enhanced search results, comprehensive answers, and a new type of interactive experience.
While the chatbots -- trained on extensive datasets from the entire internet -- can answer any healthcare-related queries, they are also capable of generating disinformation and nonsensical or harmful content, said the team from the Friedrich-Alexander-Universitat Erlangen-Nurnberg in Germany.
Advertisement
“In this cross-sectional study, we observed that search engines with an AI-powered chatbot produced overall complete and accurate answers to patient questions,” they write.
“However, chatbot answers were largely difficult to read and answers repeatedly lacked information or showed inaccuracies, possibly threatening patient and medication safety,” they add.
For the study, the researchers explored the readability, completeness, and accuracy of chatbot answers for queries on the top 50 most frequently prescribed drugs in the US in 2020. They used Bing copilot, a search engine with AI-powered chatbot features.
Just half of the 10 questions were answered with the highest completeness. Further, chatbot statements didn’t match the reference data in 26 per cent of answers and were fully inconsistent in over 3 per cent of cases.
About 42 per cent of these chatbot answers were considered to lead to moderate or mild harm, and 22 per cent to death or severe harm.
The team noted that a major drawback was the chatbot’s inability to understand the underlying intent of a patient question.
“Despite their potential, it is still crucial for patients to consult their healthcare professionals, as chatbots may not always generate error-free information,” the researchers said.
Reference: Andrikyan W, Sametinger SM, Kosfeld F, et al Artificial intelligence-powered chatbots in search engines: a cross-sectional study on the quality and risks of drug information for patients. BMJ Quality & Safety Published Online First: 01 October 2024. doi: 10.1136/bmjqs-2024-017476
Full View
Tags:    
Article Source : BMJ Quality and Safety

Disclaimer: This website is primarily for healthcare professionals. The content here does not replace medical advice and should not be used as medical, diagnostic, endorsement, treatment, or prescription advice. Medical science evolves rapidly, and we strive to keep our information current. If you find any discrepancies, please contact us at corrections@medicaldialogues.in. Read our Correction Policy here. Nothing here should be used as a substitute for medical advice, diagnosis, or treatment. We do not endorse any healthcare advice that contradicts a physician's guidance. Use of this site is subject to our Terms of Use, Privacy Policy, and Advertisement Policy. For more details, read our Full Disclaimer here.

NOTE: Join us in combating medical misinformation. If you encounter a questionable health, medical, or medical education claim, email us at factcheck@medicaldialogues.in for evaluation.

Dr. Bhumika Maikhuri

Dr Bhumika Maikhuri is an orthodontist with 2 years of clinical experience. She is also working as a medical writer and anchor at Medical Dialogues. She has completed her BDS from Dr D.Y. Patil Medical College and Hospital and MDS from Kalinga Institute of Dental Sciences. She has a few publications and patents to her credit. Her diverse background in clinical dentistry and academic research uniquely positions her to contribute meaningfully to our team.

Comments Policy
Our comments section is governed by our Comments Policy . By posting comments at Medical Dialogues you automatically agree with our Comments Policy , Terms And Conditions and Privacy Policy .

Similar News

14 Extra Steps a Minute Could Improve Mobility in Seniors: Study Suggests

Diet, Income, and City Living Raise Antibiotic Resistance and Mortality Risk: Study Finds

Want to Live Longer? Stay Active, Study Suggests

Gabapentin Tied to 85 Percent Higher Risk of Cognitive Impairment: Study Finds

Alarming Growth in Antifungal Resistance Tracked Over 30 Years in Dutch Study

Are You Choosing the Right Workout for Your Personality Type? Study Provides Insights

Micro labs to offer mucolytic solution for respiratory care with its recently launched Pulmucus range

PCOS Patients Feel Dismissed and Underserved: Study Suggests