Medical Dialogues
  • Dermatology
Login Register
This site is intended for healthcare professionals only
Login Register
  • MD Brand Connect
  • Vaccine Hub
  • MDTV
    • Breaking News
    • Medical News Today
    • Health News Today
    • Latest
    • Journal Club
    • Medico Legal Update
    • Latest Webinars
    • MD Shorts
    • Health Dialogues
  • Fact Check
  • Health Dialogues
Medical Dialogues
  • Medical News & Guidelines
      • Anesthesiology
      • Cardiology and CTVS
      • Critical Care
      • Dentistry
      • Dermatology
      • Diabetes and Endocrinology
      • ENT
      • Gastroenterology
      • Medicine
      • Nephrology
      • Neurology
      • Obstretics-Gynaecology
      • Oncology
      • Ophthalmology
      • Orthopaedics
      • Pediatrics-Neonatology
      • Psychiatry
      • Pulmonology
      • Radiology
      • Surgery
      • Urology
      • Laboratory Medicine
      • Diet
      • Nursing
      • Paramedical
      • Physiotherapy
  • Health news
      • Doctor News
      • Government Policies
      • Hospital & Diagnostics
      • International Health News
      • Medical Organization News
      • Medico Legal News
      • NBE News
      • NMC News
  • Fact Check
      • Bone Health Fact Check
      • Brain Health Fact Check
      • Cancer Related Fact Check
      • Child Care Fact Check
      • Dental and oral health fact check
      • Diabetes and metabolic health fact check
      • Diet and Nutrition Fact Check
      • Eye and ENT Care Fact Check
      • Fitness fact check
      • Gut health fact check
      • Heart health fact check
      • Kidney health fact check
      • Medical education fact check
      • Men's health fact check
      • Respiratory fact check
      • Skin and hair care fact check
      • Vaccine and Immunization fact check
      • Women's health fact check
  • AYUSH
    • Ayurveda
    • Homeopathy
    • Siddha
    • Unani
    • Yoga
  • State News
      • Andaman and Nicobar Islands
      • Andhra Pradesh
      • Arunachal Pradesh
      • Assam
      • Bihar
      • Chandigarh
      • Chattisgarh
      • Dadra and Nagar Haveli
      • Daman and Diu
      • Delhi
      • Goa
      • Gujarat
      • Haryana
      • Himachal Pradesh
      • Jammu & Kashmir
      • Jharkhand
      • Karnataka
      • Kerala
      • Ladakh
      • Lakshadweep
      • Madhya Pradesh
      • Maharashtra
      • Manipur
      • Meghalaya
      • Mizoram
      • Nagaland
      • Odisha
      • Puducherry
      • Punjab
      • Rajasthan
      • Sikkim
      • Tamil Nadu
      • Telangana
      • Tripura
      • Uttar Pradesh
      • Uttrakhand
      • West Bengal
  • Medical Education
      • Ayush Education News
      • Dentistry Education News
      • Medical Admission News
      • Medical Colleges News
      • Medical Courses News
      • Medical Universities News
      • Nursing education News
      • Paramedical Education News
      • Study Abroad
  • Industry
      • Health Investment News
      • Health Startup News
      • Medical Devices News
      • Pharma News
      • Pharmacy Education News
      • Industry Perspective
  • MDTV
      • Health Dialogues MDTV
      • Health News today MDTV
      • Latest Videos MDTV
      • Latest Webinars MDTV
      • MD shorts MDTV
      • Medical News Today MDTV
      • Medico Legal Update MDTV
      • Top Videos MDTV
      • Health Perspectives MDTV
      • Journal Club MDTV
      • Medical Dialogues Show
This site is intended for healthcare professionals only
LoginRegister
Medical Dialogues
LoginRegister
  • Home
  • Medical news & Guidelines
    • Anesthesiology
    • Cardiology and CTVS
    • Critical Care
    • Dentistry
    • Dermatology
    • Diabetes and Endocrinology
    • ENT
    • Gastroenterology
    • Medicine
    • Nephrology
    • Neurology
    • Obstretics-Gynaecology
    • Oncology
    • Ophthalmology
    • Orthopaedics
    • Pediatrics-Neonatology
    • Psychiatry
    • Pulmonology
    • Radiology
    • Surgery
    • Urology
    • Laboratory Medicine
    • Diet
    • Nursing
    • Paramedical
    • Physiotherapy
  • Health news
    • Doctor News
    • Government Policies
    • Hospital & Diagnostics
    • International Health News
    • Medical Organization News
    • Medico Legal News
    • NBE News
    • NMC News
  • Fact Check
    • Bone Health Fact Check
    • Brain Health Fact Check
    • Cancer Related Fact Check
    • Child Care Fact Check
    • Dental and oral health fact check
    • Diabetes and metabolic health fact check
    • Diet and Nutrition Fact Check
    • Eye and ENT Care Fact Check
    • Fitness fact check
    • Gut health fact check
    • Heart health fact check
    • Kidney health fact check
    • Medical education fact check
    • Men's health fact check
    • Respiratory fact check
    • Skin and hair care fact check
    • Vaccine and Immunization fact check
    • Women's health fact check
  • AYUSH
    • Ayurveda
      • Ayurveda Giuidelines
      • Ayurveda News
    • Homeopathy
      • Homeopathy Guidelines
      • Homeopathy News
    • Siddha
      • Siddha Guidelines
      • Siddha News
    • Unani
      • Unani Guidelines
      • Unani News
    • Yoga
      • Yoga Guidelines
      • Yoga News
  • State News
    • Andaman and Nicobar Islands
    • Andhra Pradesh
    • Arunachal Pradesh
    • Assam
    • Bihar
    • Chandigarh
    • Chattisgarh
    • Dadra and Nagar Haveli
    • Daman and Diu
    • Delhi
    • Goa
    • Gujarat
    • Haryana
    • Himachal Pradesh
    • Jammu & Kashmir
    • Jharkhand
    • Karnataka
    • Kerala
    • Ladakh
    • Lakshadweep
    • Madhya Pradesh
    • Maharashtra
    • Manipur
    • Meghalaya
    • Mizoram
    • Nagaland
    • Odisha
    • Puducherry
    • Punjab
    • Rajasthan
    • Sikkim
    • Tamil Nadu
    • Telangana
    • Tripura
    • Uttar Pradesh
    • Uttrakhand
    • West Bengal
  • Medical Education
    • Ayush Education News
    • Dentistry Education News
    • Medical Admission News
    • Medical Colleges News
    • Medical Courses News
    • Medical Universities News
    • Nursing education News
    • Paramedical Education News
    • Study Abroad
  • Industry
    • Health Investment News
    • Health Startup News
    • Medical Devices News
    • Pharma News
      • CDSCO (Central Drugs Standard Control Organisation) News
    • Pharmacy Education News
    • Industry Perspective
  • Home
  • Radiology
  • Radiology News
  • ChatGPT-4 Struggles...

ChatGPT-4 Struggles Interpreting Radiological Anatomy in FRCR Part 1 Mock Exam, Study Finds

Written By : Dr. Garima Soni |Medically Reviewed By : Dr. Kamal Kant Kohli Published On 2024-11-29T18:07:28+05:30  |  Updated On 30 Nov 2024 11:04 AM IST
Artificial Intelligence
  • facebook
  • twitter
  • linkedin
  • whatsapp
  • Telegram
  • Email

India: With artificial intelligence growing in hospitals to improve patient outcomes, Indian doctors conducted a study that evaluated the efficacy of ChatGPT-4 in answering radiological anatomy and found that ChatGPT-4 has underperformed in interpreting normal radiological anatomy. The study was published in the Indian Journal of Radiology and Imaging.

Dr. Pradosh Kumar Sarangi, MD, PDF, EDiR, Department of Radiodiagnosis, AIIMS Deoghar, Jharkhand, and the study's author, explained to Medical Dialogues, "The study evaluated ChatGPT-4's performance in identifying radiological anatomy in mock First Fellowship of the Royal College of Radiologists (FRCR) Part 1 examination questions. While the AI demonstrated 100% accuracy in identifying imaging modalities, it struggled with anatomical structure identification (4-7.5% accuracy) and sidedness (~40%). This highlights its potential as a supplementary educational tool but underscores significant limitations for clinical use.”

Anatomical knowledge is essential in radiology, providing the foundation for accurate image interpretation and diagnosis across imaging modalities like X-rays, CT scans, MRI, and ultrasound. As AI advances, its role in medical education and exam preparation has expanded. OpenAI's ChatGPT-4, known for its capabilities in natural language processing, has shown promise across various medical fields. The FRCR Part 1 examination, a key milestone for radiology trainees, tests their knowledge of radiological anatomy and other core topics.

Dr. Sarangi and his team conducted a study to assess ChatGPT-4's ability to identify radiological anatomy in line with the FRCR Part 1 pattern. They used 100 mock radiological anatomy questions from a free website mimicking the exam. ChatGPT-4 was tested with and without context about the exam instructions. The main question was: “Identify the structure indicated by the arrow(s).” Responses were compared to correct answers, with two expert radiologists ((>5 and 30 years of experience) rating the explanations.

Four scores were assessed: correctness, sidedness, modality identification, and approximation. The latter accounts for partial correctness when the structure identified is present, but not the specific focus of the question.

The study reveals the following findings:

  • ChatGPT-4 performed poorly in both testing conditions, with correctness scores of 4% without context and 7.5% with context.
  • It identified the imaging modality with 100% accuracy and scored over 50% on the approximation metric by recognizing structures present in the image but not indicated by the arrow.
  • ChatGPT-4 had difficulty identifying the correct side of the structure, scoring around 42% without context and 40% with context. only 32% of the responses were consistent across both settings.

Dr. Sarangi explained that “ChatGPT-4’s current limitations in accuracy and reliability restrict its utility for high-stakes clinical applications, emphasizing the need for improved training on domain-specific datasets.”

Discussing the future evolution of AI in radiology, Dr. Sarangi added,” AI in radiology is likely to evolve into hybrid systems integrating visual recognition with language models, improving interpretative skills for complex imaging. Future advancements could include real-time AI support for identifying anatomical structures during imaging reviews, improved clinical decision support tools, and personalized learning platforms for radiology students.”

Reference: Sarangi, P. K., Datta, S., Panda, B. B., Panda, S., & Mondal, H. (2024). Evaluating ChatGPT-4's performance in identifying radiological anatomy in FRCR Part 1 examination questions. Indian Journal of Radiology and Imaging. https://doi.org/10.1055/s-0044-1792040.

chatgpt4radiologyanatomyaifrcr part1
Source : Indian Journal of Radiology and Imaging
Dr. Garima Soni
Dr. Garima Soni

    BDS, MDS(orthodontics)

    Dr. Garima Soni holds a BDS (Bachelor of Dental Surgery) from Government Dental College, Raipur, Chhattisgarh, and an MDS (Master of Dental Surgery) specializing in Orthodontics and Dentofacial Orthopedics from Maitri College of Dentistry and Research Centre. At medical dialogues she focuses on dental news and dental and medical fact checks against medical/dental mis/disinformation

    Dr. Kamal Kant Kohli
    Dr. Kamal Kant Kohli

    Dr Kamal Kant Kohli-MBBS, DTCD- a chest specialist with more than 30 years of practice and a flair for writing clinical articles, Dr Kamal Kant Kohli joined Medical Dialogues as a Chief Editor of Medical News. Besides writing articles, as an editor, he proofreads and verifies all the medical content published on Medical Dialogues including those coming from journals, studies,medical conferences,guidelines etc. Email: drkohli@medicaldialogues.in. Contact no. 011-43720751

    Show Full Article
    Next Story

    Editorial

    Aspirin in Primary Prevention of Stroke-Review of Evidence Through the Needs of Indian Clinical Settings

    Aspirin in Primary Prevention of Stroke-Review of Evidence Through the Needs of Indian Clinical...

    Dapagliflozin Shines in Post-TAVI Patients:DAPA-TAVI Trial Findings

    Dapagliflozin Shines in Post-TAVI Patients:DAPA-TAVI Trial Findings

    Identifying Candidates for Aspirin in Primary Prevention: Men Aged 40-50 with Hypertension, Dyslipidemia, and Familial ASCVD Risk

    Identifying Candidates for Aspirin in Primary Prevention: Men Aged 40-50 with Hypertension,...

    Featured image representing thinking

    Is Pharma Marketing Going Through "Thinking Recession"?

    Beyond BMI: Why Pioglitazone Deserves a Place in Managing Thin-Fat Type 2 Diabetes in India

    Beyond BMI: Why Pioglitazone Deserves a Place in Managing 'Thin-Fat' Type 2 Diabetes in India

    View All

    Journal Club Today

    Decades After Diagnosis, Childhood Cancer Survivors Still Vulnerable to Severe COVID: Study Shows

    Decades After Diagnosis, Childhood Cancer Survivors Still Vulnerable to Severe COVID: Study Shows

    View All

    Health News Today

    Health Bulletin 7/July/ 2025

    Health Bulletin 7/July/ 2025

    View All
    © 2022 All Rights Reserved.
    Powered By: Hocalwire
    X
    We use cookies for analytics, advertising and to improve our site. You agree to our use of cookies by continuing to use our site. To know more, see our Cookie Policy and Cookie Settings.Ok