研究发现生成模型在MRI重建中易被噪声干扰产生虚假图像,威胁诊断安全。
Triggering hallucinations in model-based MRI reconstruction via adversarial perturbations
- 用对抗扰动模拟噪声,诱导生成模型产生幻觉。
- 在fastMRI数据集上,小扰动即引发明显幻觉,检测困难。
- 结果提示需通过对抗训练提升模型鲁棒性,适合医疗AI安全研究者。
生成模型在医学影像重建(如磁共振成像、计算机断层扫描)中应用日益广泛,但其易产生幻觉——在重建图像中加入原图不存在的特征。在临床场景中,这类幻觉可能误导诊断,危及患者安全。本文旨在量化先进生成模型在磁共振图像重建中的幻觉敏感度。具体地,我们对未处理输入图像施加类似随机噪声的对抗扰动,观察其在生成模型重建下是否诱发幻觉。实验基于fastMRI数据集中的脑部与膝关节图像,采用UNet和端到端VarNet架构进行重建。结果表明,这些模型对微小扰动极为敏感,极易被诱导产生幻觉。这种脆弱性或可解释幻觉产生的根源,并提示通过精心设计的对抗训练可降低幻觉发生率。此外,传统图像质量评估指标无法可靠检测此类幻觉,因此亟需新方法来识别幻觉发生。
原文摘要 · Abstract (English)
Generative models are increasingly used to improve the quality of medical imaging, such as reconstruction of magnetic resonance images and computed tomography. However, it is well-known that such models are susceptible to hallucinations: they may insert features into the reconstructed image which are not actually present in the original image. In a medical setting, such hallucinations may endanger patient health as they can lead to incorrect diagnoses. In this work, we aim to quantify the extent to which state-of-the-art generative models suffer from hallucinations in the context of magnetic resonance image reconstruction. Specifically, we craft adversarial perturbations resembling random noise for the unprocessed input images which induce hallucinations when reconstructed using a generative model. We perform this evaluation on the brain and knee images from the fastMRI data set using UNet and end-to-end VarNet architectures to reconstruct the images. Our results show that these models are highly susceptible to small perturbations and can be easily coaxed into producing hallucinations. This fragility may partially explain why hallucinations occur in the first place and suggests that a carefully constructed adversarial training routine may reduce their prevalence. Moreover, these hallucinations cannot be reliably detected using traditional image quality metrics. Novel approaches will therefore need to be developed to detect when hallucinations have occurred.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。