提出统一模型LCMem,提升跨域图像记忆检测精度与鲁棒性。
LCMem: A Universal Model for Robust Image Memorization Detection
- 将记忆检测视为重识别与复制检测的统一问题,分两阶段训练。
- 在六大数据集上重识别提升16个百分点,复制检测提升30个百分点。
- 适合需要高可靠隐私审计的生成模型开发者和安全研究者。
生成图像建模的最新进展已达到足以欺骗人类专家的视觉真实度,但其在隐私保护数据共享中的潜力仍不明确。主要障碍在于缺乏可靠的记忆检测机制、量化评估不足,以及现有隐私审计方法在跨领域泛化能力差。为此,我们将记忆检测视为重识别与复制检测的统一问题,二者互补目标覆盖身份一致性和抗增强复制检测。我们提出潜空间对比记忆网络(LCMem),一种在两个任务上联合评估的跨域模型。LCMem通过两阶段训练策略,先学习身份一致性,再引入抗增强复制检测。在六个基准数据集上,LCMem在重识别任务上最高提升16个百分点,在复制检测任务上提升30个百分点,显著提升大规模记忆检测的可靠性。结果表明,现有隐私过滤器性能和鲁棒性有限,亟需更强的保护机制。我们证明,LCMem为跨域隐私审计设立了新标准,提供可靠且可扩展的记忆检测方案。代码与模型公开于 https://github.com/MischaD/LCMem。
原文摘要 · Abstract (English)
Recent advances in generative image modeling have achieved visual realism sufficient to deceive human experts, yet their potential for privacy preserving data sharing remains insufficiently understood. A central obstacle is the absence of reliable memorization detection mechanisms, limited quantitative evaluation, and poor generalization of existing privacy auditing methods across domains. To address this, we propose to view memorization detection as a unified problem at the intersection of re-identification and copy detection, whose complementary goals cover both identity consistency and augmentation-robust duplication, and introduce Latent Contrastive Memorization Network (LCMem), a cross-domain model evaluated jointly on both tasks. LCMem achieves this through a two-stage training strategy that first learns identity consistency before incorporating augmentation-robust copy detection. Across six benchmark datasets, LCMem achieves improvements of up to 16 percentage points on re-identification and 30 percentage points on copy detection, enabling substantially more reliable memorization detection at scale. Our results show that existing privacy filters provide limited performance and robustness, highlighting the need for stronger protection mechanisms. We show that LCMem sets a new standard for cross-domain privacy auditing, offering reliable and scalable memorization detection. Code and model is publicly available at https://github.com/MischaD/LCMem.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。