提出sFRC方法,用傅里叶环相关检测医学图像恢复中的幻觉问题。
sFRC for assessing hallucinations in medical image restoration
- 基于小块傅里叶环相关扫描,定量检测图像恢复中的幻觉特征。
- 在CT和MRI任务中验证了其对幻觉的敏感性,与理论预测一致。
- 适用于深度学习及传统重建方法,适合医疗影像质量评估者使用。
深度学习(DL)正被用于从稀疏视图、有限数据及欠采样获取的医学图像中进行恢复。尽管DL输出在视觉上可能更清晰、噪声更少,但可能存在幻觉问题。现有缺乏简便有效的幻觉检测技术与鲁棒指标。本文提出在小块区域进行傅里叶环相关(FRC)分析,并同步扫描DL输出及其参考图像,以检测幻觉(称为sFRC)。我们阐述了sFRC的原理并给出数学表达式,参数可由领域专家标注的幻觉特征或成像理论生成的幻觉图确定。在三种欠采样医学成像任务中测试:CT超分辨率、稀疏视角CT和MRI欠采样恢复。实验表明,sFRC能有效检测CT任务中的幻觉,且在MRI任务中与成像理论预测的幻觉图高度一致。进一步量化了不同分布数据及不同欠采样率下DL方法的幻觉率,评估其鲁棒性。此外,sFRC也成功检测到传统正则化方法和前沿展开式方法的幻觉。
原文摘要 · Abstract (English)
Deep learning (DL) methods are currently being explored to restore images from sparse-view-, limited-data-, and undersampled-based acquisitions in medical applications. Although outputs from DL may appear visually appealing based on likability/subjective criteria (such as less noise, smooth features), they may also suffer from hallucinations. This issue is further exacerbated by a lack of easy-to-use techniques and robust metrics for the identification of hallucinations in DL outputs. In this work, we propose performing Fourier Ring Correlation (FRC) analysis over small patches and concomitantly (s)canning across DL outputs and their reference counterparts to detect hallucinations (termed as sFRC). We describe the rationale behind sFRC and provide its mathematical formulation. The parameters essential to sFRC may be set using predefined hallucinated features annotated by subject matter experts or using imaging theory-based hallucination maps. We use sFRC to detect hallucinations for three undersampled medical imaging problems: CT super-resolution, CT sparse view, and MRI subsampled restoration. In the testing phase, we demonstrate sFRC's effectiveness in detecting hallucinated features for the CT problem and sFRC's agreement with imaging theory-based outputs on hallucinated feature maps for the MR problem. Finally, we quantify the hallucination rates of DL methods on in-distribution versus out-of-distribution data and under increasing subsampling rates to characterize the robustness of DL methods. Beyond DL-based methods, sFRC's effectiveness in detecting hallucinations for a conventional regularization-based restoration method and a state-of-the-art unrolled method is also shown.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。