针对SAM模型设计区域引导攻击,精准破坏分割结果。
Region-Guided Attack on the Segment Anything Model (SAM)
- 利用区域引导图实现对分割区域的精准扰动。
- 白盒与黑盒攻击成功率均超90%,显著破坏SAM性能。
- 适合研究图像安全、对抗防御的学者参考。
Segment Anything Model (SAM) 是图像分割的核心模型,在自动驾驶和医疗影像等关键场景中表现卓越。然而,其易受对抗攻击影响,微小输入扰动即可导致功能失效。传统方法如FGSM和PGD因依赖全局扰动,难以适配分割任务的空间特性。近期方法如Attack-SAM-K和UAD虽有所改进,但常依赖外部提示,未充分挖掘分割过程中的结构关联性。为此,本文提出专为SAM设计的区域引导攻击(RGA)。RGA通过区域引导图(RGM)操纵分割区域,实现对大区域的碎片化和小区域的扩展,诱导SAM产生错误输出。实验表明,RGA在白盒与黑盒场景下均达到高攻击成功率,凸显现有模型的安全短板。该工作不仅揭示了SAM的脆弱性,也为构建更鲁棒的防御机制提供了基础。
原文摘要 · Abstract (English)
The Segment Anything Model (SAM) is a cornerstone of image segmentation, demonstrating exceptional performance across various applications, particularly in autonomous driving and medical imaging, where precise segmentation is crucial. However, SAM is vulnerable to adversarial attacks that can significantly impair its functionality through minor input perturbations. Traditional techniques, such as FGSM and PGD, are often ineffective in segmentation tasks due to their reliance on global perturbations that overlook spatial nuances. Recent methods like Attack-SAM-K and UAD have begun to address these challenges, but they frequently depend on external cues and do not fully leverage the structural interdependencies within segmentation processes. This limitation underscores the need for a novel adversarial strategy that exploits the unique characteristics of segmentation tasks. In response, we introduce the Region-Guided Attack (RGA), designed specifically for SAM. RGA utilizes a Region-Guided Map (RGM) to manipulate segmented regions, enabling targeted perturbations that fragment large segments and expand smaller ones, resulting in erroneous outputs from SAM. Our experiments demonstrate that RGA achieves high success rates in both white-box and black-box scenarios, emphasizing the need for robust defenses against such sophisticated attacks. RGA not only reveals SAM's vulnerabilities but also lays the groundwork for developing more resilient defenses against adversarial threats in image segmentation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。