通过傅里叶对称性提升隐空间扩散模型水印的鲁棒性与图像质量。
Semantic Watermarking Reinvented: Enhancing Robustness and Generation Quality with Fourier Integrity
- 采用赫尔米特对称傅里叶水印,保持频域完整性。
- 中心感知嵌入策略有效抵抗裁剪攻击,提升检测准确率。
- 在多种攻击下表现最优,同时保持高图像保真度。
针对隐空间扩散模型(LDMs)语义水印在再生攻击下虽具鲁棒性但频域完整性易受损的问题,本文提出赫尔米特对称傅里叶水印(SFW)方法,通过强制赫尔米特对称性维持频域结构。同时引入中心感知嵌入策略,增强对裁剪攻击的抗性。实验表明,SFW在多种攻击场景下均实现当前最优的验证与识别性能。消融研究证实:SFW显著提升检测能力,中心感知策略有效缓解裁剪影响,消息容量与识别精度正相关。本方法在保证最高检测准确率的同时,图像保真度优异,FID与CLIP得分均领先。结论表明,SFW有效平衡了鲁棒性与图像质量,解决了语义水印固有的权衡问题。代码已开源。
原文摘要 · Abstract (English)
Semantic watermarking techniques for latent diffusion models (LDMs) are robust against regeneration attacks, but often suffer from detection performance degradation due to the loss of frequency integrity. To tackle this problem, we propose a novel embedding method called Hermitian Symmetric Fourier Watermarking (SFW), which maintains frequency integrity by enforcing Hermitian symmetry. Additionally, we introduce a center-aware embedding strategy that reduces the vulnerability of semantic watermarking due to cropping attacks by ensuring robust information retention. To validate our approach, we apply these techniques to existing semantic watermarking schemes, enhancing their frequency-domain structures for better robustness and retrieval accuracy. Extensive experiments demonstrate that our methods achieve state-of-the-art verification and identification performance, surpassing previous approaches across various attack scenarios. Ablation studies confirm the impact of SFW on detection capabilities, the effectiveness of the center-aware embedding against cropping, and how message capacity influences identification accuracy. Notably, our method achieves the highest detection accuracy while maintaining superior image fidelity, as evidenced by FID and CLIP scores. Conclusively, our proposed SFW is shown to be an effective framework for balancing robustness and image fidelity, addressing the inherent trade-offs in semantic watermarking. Code available at https://github.com/thomas11809/SFWMark
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。