arXiv:2503.08346cs.CV2025-03被引 3

为医学图像生成设计自适应水印,保护隐私同时不干扰病灶区域。

Pathology-Aware Adaptive Watermarking for Text-Driven Medical Image Synthesis

  • 基于文本-医学图像注意力图动态调节水印强度。
  • 在MIMIC-CXR和OIA-ODIR数据集上保持诊断准确性与水印可检测性。
  • 适合医疗图像生成安全防护,尤其关注病灶区域保真度。

近期文本条件扩散模型实现了高质量图像生成,但其潜在滥用问题日益突出,尤其在医疗领域可能用于保险欺诈或伪造病历,亟需可靠防护机制。尽管水印技术在通用图像领域已有进展,但在医学影像中直接应用面临挑战:微小的水印扰动可能影响病灶细节,导致误诊,破坏诊断完整性。为此,我们提出专为文本到医学图像合成设计的MedSign框架,通过自适应调整水印强度,保护病理关键区域。具体地,利用医学文本词元与扩散去噪网络之间的交叉注意力,聚合多层、多头及时间步的注意力信息,生成病理定位图;基于该图优化潜在扩散模型(LDM)解码器,在图像生成中融入水印,实现一致性融合并最小化对诊断关键区域的干扰。实验表明,MedSign在保持诊断完整性的同时确保水印鲁棒性,在MIMIC-CXR和OIA-ODIR数据集上达到当前最优的图像质量与检测准确率。

原文摘要 · Abstract (English)

As recent text-conditioned diffusion models have enabled the generation of high-quality images, concerns over their potential misuse have also grown. This issue is critical in the medical domain, where text-conditioned generated medical images could enable insurance fraud or falsified records, highlighting the urgent need for reliable safeguards against unethical use. While watermarking techniques have emerged as a promising solution in general image domains, their direct application to medical imaging presents significant challenges. A key challenge is preserving fine-grained disease manifestations, as even minor distortions from a watermark may lead to clinical misinterpretation, which compromises diagnostic integrity. To overcome this gap, we present MedSign, a deep learning-based watermarking framework specifically designed for text-to-medical image synthesis, which preserves pathologically significant regions by adaptively adjusting watermark strength. Specifically, we generate a pathology localization map using cross-attention between medical text tokens and the diffusion denoising network, aggregating token-wise attention across layers, heads, and time steps. Leveraging this map, we optimize the LDM decoder to incorporate watermarking during image synthesis, ensuring cohesive integration while minimizing interference in diagnostically critical regions. Experimental results show that our MedSign preserves diagnostic integrity while ensuring watermark robustness, achieving state-of-the-art performance in image quality and detection accuracy on MIMIC-CXR and OIA-ODIR datasets.

医学图像水印扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。