Medical Dialogues
  • Dermatology
Login Register
This site is intended for healthcare professionals only
Login Register
  • MD Brand Connect
  • Vaccine Hub
  • MDTV
    • Breaking News
    • Medical News Today
    • Health News Today
    • Latest
    • Journal Club
    • Medico Legal Update
    • Latest Webinars
    • MD Shorts
    • Health Dialogues
  • Fact Check
  • Health Dialogues
Medical Dialogues
  • Medical News & Guidelines
      • Anesthesiology
      • Cardiology and CTVS
      • Critical Care
      • Dentistry
      • Dermatology
      • Diabetes and Endocrinology
      • ENT
      • Gastroenterology
      • Medicine
      • Nephrology
      • Neurology
      • Obstretics-Gynaecology
      • Oncology
      • Ophthalmology
      • Orthopaedics
      • Pediatrics-Neonatology
      • Psychiatry
      • Pulmonology
      • Radiology
      • Surgery
      • Urology
      • Laboratory Medicine
      • Diet
      • Nursing
      • Paramedical
      • Physiotherapy
  • Health news
      • Doctor News
      • Government Policies
      • Hospital & Diagnostics
      • International Health News
      • Medical Organization News
      • Medico Legal News
      • NBE News
      • NMC News
  • Fact Check
      • Bone Health Fact Check
      • Brain Health Fact Check
      • Cancer Related Fact Check
      • Child Care Fact Check
      • Dental and oral health fact check
      • Diabetes and metabolic health fact check
      • Diet and Nutrition Fact Check
      • Eye and ENT Care Fact Check
      • Fitness fact check
      • Gut health fact check
      • Heart health fact check
      • Kidney health fact check
      • Medical education fact check
      • Men's health fact check
      • Respiratory fact check
      • Skin and hair care fact check
      • Vaccine and Immunization fact check
      • Women's health fact check
  • AYUSH
    • Ayurveda
    • Homeopathy
    • Siddha
    • Unani
    • Yoga
  • State News
      • Andaman and Nicobar Islands
      • Andhra Pradesh
      • Arunachal Pradesh
      • Assam
      • Bihar
      • Chandigarh
      • Chattisgarh
      • Dadra and Nagar Haveli
      • Daman and Diu
      • Delhi
      • Goa
      • Gujarat
      • Haryana
      • Himachal Pradesh
      • Jammu & Kashmir
      • Jharkhand
      • Karnataka
      • Kerala
      • Ladakh
      • Lakshadweep
      • Madhya Pradesh
      • Maharashtra
      • Manipur
      • Meghalaya
      • Mizoram
      • Nagaland
      • Odisha
      • Puducherry
      • Punjab
      • Rajasthan
      • Sikkim
      • Tamil Nadu
      • Telangana
      • Tripura
      • Uttar Pradesh
      • Uttrakhand
      • West Bengal
  • Medical Education
      • Ayush Education News
      • Dentistry Education News
      • Medical Admission News
      • Medical Colleges News
      • Medical Courses News
      • Medical Universities News
      • Nursing education News
      • Paramedical Education News
      • Study Abroad
  • Industry
      • Health Investment News
      • Health Startup News
      • Medical Devices News
      • Pharma News
      • Pharmacy Education News
      • Industry Perspective
  • MDTV
      • Health Dialogues MDTV
      • Health News today MDTV
      • Latest Videos MDTV
      • Latest Webinars MDTV
      • MD shorts MDTV
      • Medical News Today MDTV
      • Medico Legal Update MDTV
      • Top Videos MDTV
      • Health Perspectives MDTV
      • Journal Club MDTV
      • Medical Dialogues Show
This site is intended for healthcare professionals only
LoginRegister
Medical Dialogues
LoginRegister
  • Home
  • Medical news & Guidelines
    • Anesthesiology
    • Cardiology and CTVS
    • Critical Care
    • Dentistry
    • Dermatology
    • Diabetes and Endocrinology
    • ENT
    • Gastroenterology
    • Medicine
    • Nephrology
    • Neurology
    • Obstretics-Gynaecology
    • Oncology
    • Ophthalmology
    • Orthopaedics
    • Pediatrics-Neonatology
    • Psychiatry
    • Pulmonology
    • Radiology
    • Surgery
    • Urology
    • Laboratory Medicine
    • Diet
    • Nursing
    • Paramedical
    • Physiotherapy
  • Health news
    • Doctor News
    • Government Policies
    • Hospital & Diagnostics
    • International Health News
    • Medical Organization News
    • Medico Legal News
    • NBE News
    • NMC News
  • Fact Check
    • Bone Health Fact Check
    • Brain Health Fact Check
    • Cancer Related Fact Check
    • Child Care Fact Check
    • Dental and oral health fact check
    • Diabetes and metabolic health fact check
    • Diet and Nutrition Fact Check
    • Eye and ENT Care Fact Check
    • Fitness fact check
    • Gut health fact check
    • Heart health fact check
    • Kidney health fact check
    • Medical education fact check
    • Men's health fact check
    • Respiratory fact check
    • Skin and hair care fact check
    • Vaccine and Immunization fact check
    • Women's health fact check
  • AYUSH
    • Ayurveda
      • Ayurveda Giuidelines
      • Ayurveda News
    • Homeopathy
      • Homeopathy Guidelines
      • Homeopathy News
    • Siddha
      • Siddha Guidelines
      • Siddha News
    • Unani
      • Unani Guidelines
      • Unani News
    • Yoga
      • Yoga Guidelines
      • Yoga News
  • State News
    • Andaman and Nicobar Islands
    • Andhra Pradesh
    • Arunachal Pradesh
    • Assam
    • Bihar
    • Chandigarh
    • Chattisgarh
    • Dadra and Nagar Haveli
    • Daman and Diu
    • Delhi
    • Goa
    • Gujarat
    • Haryana
    • Himachal Pradesh
    • Jammu & Kashmir
    • Jharkhand
    • Karnataka
    • Kerala
    • Ladakh
    • Lakshadweep
    • Madhya Pradesh
    • Maharashtra
    • Manipur
    • Meghalaya
    • Mizoram
    • Nagaland
    • Odisha
    • Puducherry
    • Punjab
    • Rajasthan
    • Sikkim
    • Tamil Nadu
    • Telangana
    • Tripura
    • Uttar Pradesh
    • Uttrakhand
    • West Bengal
  • Medical Education
    • Ayush Education News
    • Dentistry Education News
    • Medical Admission News
    • Medical Colleges News
    • Medical Courses News
    • Medical Universities News
    • Nursing education News
    • Paramedical Education News
    • Study Abroad
  • Industry
    • Health Investment News
    • Health Startup News
    • Medical Devices News
    • Pharma News
      • CDSCO (Central Drugs Standard Control Organisation) News
    • Pharmacy Education News
    • Industry Perspective

ERS Conference Highlights: ChatGPT Surpassed Trainee Doctors in Assessing Complex Respiratory Illness In Children - Video

Published On 2024-09-10T08:45:37+05:30  |  Updated On 10 Sept 2024 3:01 PM IST
  • facebook
  • twitter
  • linkedin
  • whatsapp
  • Telegram
  • Email

Overview

The chatbot ChatGPT performed better than trainee doctors in assessing complex cases of respiratory disease in areas such as cystic fibrosis, asthma, and chest infections in a study presented at the European Respiratory Society (ERS) Congress in Vienna, Austria.

The study also showed that Google’s chatbot Bard performed better than trainees in some aspects and Microsoft’s Bing chatbot performed as well as trainees.

The research suggests that these large language models (LLMs) could be used to support trainee doctors, nurses, and general practitioners to triage patients more quickly and ease pressure on health services.

The study was presented by Dr Manjith Narayanan, a consultant in paediatric pulmonology at the Royal Hospital for Children and Young People, Edinburgh and honorary senior clinical lecturer at the University of Edinburgh, UK. He said: “Large language models, like ChatGPT, have come into prominence in the last year and a half with their ability to seemingly understand natural language and provide responses that can adequately simulate a human-like conversation. These tools have several potential applications in medicine. My motivation to carry out this research was to assess how well LLMs are able to assist clinicians in real life.”

To investigate this, Dr Narayanan used clinical scenarios that occur frequently in paediatric respiratory medicine. (23)The scenarios were provided by six other experts in paediatric respiratory medicine and covered topics like cystic fibrosis, asthma, sleep disordered breathing, breathlessness and chest infections. They were all scenarios where there is no obvious diagnosis, and where there is no published evidence, guidelines or expert consensus that point to a specific diagnosis or plan.

Ten trainee doctors who had less than four months of clinical experience in paediatrics were given an hour where they could use the internet, but not any chatbots, to solve each scenario with a descriptive answer of 200 to 400 words. Each scenario was also presented to the three chatbots.

All the responses were scored by six paediatric respiratory experts for correctness, comprehensiveness, usefulness, plausibility, and coherence. They were also asked to say whether they thought each response was human- or chatbot-generated and to give each response an overall score out of nine.

Solutions provided by ChatGPT version 3.5 scored an average of seven out of nine overall and were believed to be more human-like than responses from the other chatbots(25). Bard scored an average of six out of nine and was scored as more ‘coherent’ than trainee doctors, but in other respects was no better or worse than trainee doctors. Bing scored an average of four out of nine – the same as trainee doctors overall. Experts reliably identified Bing and Bard responses as non-human.

Dr Narayanan said: “Our study is the first, to our knowledge, to test LLMs against trainee doctors in situations that reflect real-life clinical practice. We did this by allowing the trainee doctors to have full access to resources available on the internet, as they would in real life.

This moves the focus away from testing memory, where there is a clear advantage for LLMs. Therefore, this study shows us another way we could be using LLMs and how close we are to regular day-to-day clinical application.

“We have not directly tested how LLMs would work in patient facing roles. However, it could be used by triage nurses, trainee doctors and primary care physicians, who are often the first to review a patient.”

Reference: "Clinical scenarios in paediatric pulmonology: Can large language models fare better than trainee doctors?", by Manjith Narayanan et al; Presented in session, "Respiratory care in the digital age: innovative applications and their evidence" at 09:30-10:45 CEST on Monday 9 September 2024.

Speakers

Dr. Garima Soni

BDS, MDS(orthodontics)

Dr. Garima Soni holds a BDS (Bachelor of Dental Surgery) from Government Dental College, Raipur, Chhattisgarh, and an MDS (Master of Dental Surgery) specializing in Orthodontics and Dentofacial Orthopedics from Maitri College of Dentistry and Research Centre. At medical dialogues she focuses on dental news and dental and medical fact checks against medical/dental mis/disinformation
© 2022 All Rights Reserved.
Powered By: Hocalwire
X
We use cookies for analytics, advertising and to improve our site. You agree to our use of cookies by continuing to use our site. To know more, see our Cookie Policy and Cookie Settings.Ok