提出医疗影像生成中复制品检测框架,保障患者隐私安全。
RELICT: A Replica Detection Framework for Medical Image Generation
- 结合体素、特征和分割三层次分析,检测合成影像中的重复数据。
- 在非对比头颅CT中实现100%准确识别复制品,MR血管成像达79%。
- 为医疗生成模型提供可标准化的隐私保护验证工具,适合研究者使用。
尽管合成医疗数据可增强深度学习模型的泛化能力,但生成模型的记忆现象可能导致敏感患者信息意外泄露,威胁隐私安全。本文提出一种名为RELICT的复制品检测框架,用于识别合成医疗图像数据集中几乎完全相同的训练数据副本。该框架通过三种互补方法评估图像相似性:(1)体素级分析,(2)基于预训练医学基础模型的特征级分析,(3)分割级分析。研究了两个临床相关的3D生成建模场景:774例非对比头颅CT(NCCT)和1,782例脑底动脉环时间飞跃磁共振血管造影(TOF-MRA)。以专家视觉评分作为参考标准,确认了50张图像中45张(NCCT)和5张(TOF-MRA)为复制品。在最优阈值下,图像级与特征级度量在NCCT任务中达到平衡准确率1.0;而TOF-MRA任务中,分割级分析表现最佳,平衡准确率为0.79,无法在任何阈值下实现完美分类。复制品检测是医疗影像生成模型开发中被忽视却至关重要的验证步骤。所提出的RELICT框架提供标准化、易用的检测工具,旨在推动医疗影像合成的负责任与伦理化发展。
原文摘要 · Abstract (English)
Despite the potential of synthetic medical data for augmenting and improving the generalizability of deep learning models, memorization in generative models can lead to unintended leakage of sensitive patient information and limit model utility. Thus, the use of memorizing generative models in the medical domain can jeopardize patient privacy. We propose a framework for identifying replicas, i.e. nearly identical copies of the training data, in synthetic medical image datasets. Our REpLIca deteCTion (RELICT) framework for medical image generative models evaluates image similarity using three complementary approaches: (1) voxel-level analysis, (2) feature-level analysis by a pretrained medical foundation model, and (3) segmentation-level analysis. Two clinically relevant 3D generative modelling use cases were investigated: non-contrast head CT with intracerebral hemorrhage (N=774) and time-of-flight MR angiography of the Circle of Willis (N=1,782). Expert visual scoring was used as the reference standard to assess the presence of replicas. We report the balanced accuracy at the optimal threshold to assess replica classification performance. The reference visual rating identified 45 of 50 and 5 of 50 generated images as replicas for the NCCT and TOF-MRA use cases, respectively. Image-level and feature-level measures perfectly classified replicas with a balanced accuracy of 1 when an optimal threshold was selected for the NCCT use case. A perfect classification of replicas for the TOF-MRA case was not possible at any threshold, with the segmentation-level analysis achieving a balanced accuracy of 0.79. Replica detection is a crucial but neglected validation step for the development of generative models in medical imaging. The proposed RELICT framework provides a standardized, easy-to-use tool for replica detection and aims to facilitate responsible and ethical medical image synthesis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。