Both AI and radiologists can get fooled by tampered medical images, study finds

Written By : Medha Baranwal |Medically Reviewed By : Dr. Kamal Kant Kohli Published On 2021-12-17T09:00:29+05:30 | Updated On 17 Dec 2021 9:00 AM IST

USA: A recent study published in Nature Communications suggests the need for continuing research on safety issues related to the artificial intelligence (AI) model and highlights the need for safety measures in AI. The study found that the AI model was fooled by over two-thirds of fake breast images which makes them prone to cyberattacks.

In recent years while active efforts are being made in advancing AI model development and clinical translation. New safety issues of the AI models are emerging but not much research has been done in this direction.

Shandong Wu, Department of Radiology, University of Pittsburgh, Pittsburgh, PA, USA, and colleagues performed a study investigate the behaviors of an AI diagnosis model under adversarial images generated by Generative Adversarial Network (GAN) models and to evaluate the effects on human experts when visually identifying potential adversarial images.

The GAN model makes intentional modifications to the diagnosis-sensitive contents of mammogram images in deep learning-based computer-aided diagnosis (CAD) of breast cancer.

In the authors' experiments, the adversarial samples fool the AI-CAD model to output a wrong diagnosis on 69.1% of the cases that are initially correctly classified by the AI-CAD model. Five breast imaging radiologists visually identify 29%-71% of the adversarial samples.

"Our experiments showed that highly plausible adversarial samples can be generated on mammogram images by advanced GAN algorithms, and they can induce a deep learning AI model to output a wrong diagnosis of breast cancer," wrote the authors.

"Certified human radiologists can identify such adversarial samples, but they may not be reliable to safely detect all potential adversarial samples, where an education process showed promise to improve their performance in recognizing the adversarial images," they explained. "This poses an imperative need for continuing research on the medical AI model's safety issues and for developing potential defensive solutions against adversarial attacks"

Reference:

Zhou, Q., Zuley, M., Guo, Y. et al. A machine and human reader study on AI diagnosis model safety under attacks of adversarial images. Nat Commun 12, 7281 (2021). https://doi.org/10.1038/s41467-021-27577-x

Nature Communicationsartificial intelligencemedical images

Source : Nature Communications

Medha Baranwal

MSc. Biotechnology

Medha Baranwal joined Medical Dialogues as an Editor in 2018 for Speciality Medical Dialogues. She covers several medical specialties including Cardiac Sciences, Dentistry, Diabetes and Endo, Diagnostics, ENT, Gastroenterology, Neurosciences, and Radiology. She has completed her Bachelors in Biomedical Sciences from DU and then pursued Masters in Biotechnology from Amity University. She has a working experience of 5 years in the field of medical research writing, scientific writing, content writing, and content management. She can be contacted at editorial@medicaldialogues.in. Contact no. 011-43720751

Dr. Kamal Kant Kohli

Dr Kamal Kant Kohli-MBBS, DTCD- a chest specialist with more than 30 years of practice and a flair for writing clinical articles, Dr Kamal Kant Kohli joined Medical Dialogues as a Chief Editor of Medical News. Besides writing articles, as an editor, he proofreads and verifies all the medical content published on Medical Dialogues including those coming from journals, studies,medical conferences,guidelines etc. Email: drkohli@medicaldialogues.in. Contact no. 011-43720751