arXiv:2412.09910cs.CV2024-12CVPR被引 6

用文字指令生成乳腺超声图像对抗样本,更自然且有效。

Prompt2Perturb (P2P): Text-Guided Diffusion-Based Adversarial Attacks on Breast Ultrasound Images

  • 通过可学习提示直接优化文本嵌入,生成隐蔽扰动。
  • 在三个乳腺超声数据集上,FID和LPIPS指标优于现有方法。
  • 无需重训练扩散模型,适合数据稀缺的医疗场景。

深度神经网络在提升乳腺癌医学影像诊断方面潜力巨大,但极易受到对抗攻击——微小且难以察觉的扰动可能误导分类器,引发可靠性与安全性担忧。传统攻击依赖固定范数扰动,与人类感知不符;基于扩散模型的攻击需预训练模型,在数据稀缺场景下难以应用。本文提出Prompt2Perturb(P2P),一种由文本指令驱动的新型对抗攻击方法。该方法利用文本编码器中的可学习提示,在不重训练扩散模型的前提下生成微妙却有效的扰动。通过仅优化早期反向扩散步骤,提升了效率并保持图像质量,避免引入明显伪影。实验表明,P2P在三个乳腺超声数据集上均优于当前最优攻击方法,生成图像更自然、更具攻击性。代码将公开于https://github.com/yasamin-med/P2P。

原文摘要 · Abstract (English)

Deep neural networks (DNNs) offer significant promise for improving breast cancer diagnosis in medical imaging. However, these models are highly susceptible to adversarial attacks--small, imperceptible changes that can mislead classifiers--raising critical concerns about their reliability and security. Traditional attacks rely on fixed-norm perturbations, misaligning with human perception. In contrast, diffusion-based attacks require pre-trained models, demanding substantial data when these models are unavailable, limiting practical use in data-scarce scenarios. In medical imaging, however, this is often unfeasible due to the limited availability of datasets. Building on recent advancements in learnable prompts, we propose Prompt2Perturb (P2P), a novel language-guided attack method capable of generating meaningful attack examples driven by text instructions. During the prompt learning phase, our approach leverages learnable prompts within the text encoder to create subtle, yet impactful, perturbations that remain imperceptible while guiding the model towards targeted outcomes. In contrast to current prompt learning-based approaches, our P2P stands out by directly updating text embeddings, avoiding the need for retraining diffusion models. Further, we leverage the finding that optimizing only the early reverse diffusion steps boosts efficiency while ensuring that the generated adversarial examples incorporate subtle noise, thus preserving ultrasound image quality without introducing noticeable artifacts. We show that our method outperforms state-of-the-art attack techniques across three breast ultrasound datasets in FID and LPIPS. Moreover, the generated images are both more natural in appearance and more effective compared to existing adversarial attacks. Our code will be publicly available https://github.com/yasamin-med/P2P.

对抗攻击扩散模型医学影像文本引导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。