评测分割模型在局部自然与对抗扰动下的鲁棒性,发现模型表现差异显著。
Benchmarking the Spatial Robustness of DNNs via Natural and Adversarial Localized Corruptions
- 设计区域感知指标与多攻击分析框架,评估局部扰动影响。
- 14个模型测试显示,基于Transformer的模型对自然扰动鲁棒但易受对抗攻击。
- 提出集成模型平衡两类威胁,提升密集视觉任务可靠性。
深度神经网络的鲁棒性在安全关键应用中至关重要,尤其在医疗或驾驶等复杂动态环境中,局部扰动可能频繁出现。尽管已有研究评估了语义分割模型在整图自然或对抗扰动下的性能,但针对密集视觉模型在局部扰动下的空间鲁棒性仍缺乏系统研究。本文引入新型区域感知指标与评估框架,用于衡量分割模型在局部自然扰动下的表现,并揭示仅用单一局部对抗攻击难以评估最坏情况下的空间鲁棒性。为此,提出区域感知的多攻击对抗分析方法,系统评估模型在特定图像区域的鲁棒性。基于该框架,对14种分割模型在驾驶场景中的表现进行了评估,发现模型对自然与对抗局部扰动的响应截然不同:基于Transformer的模型对自然局部扰动具有较强鲁棒性,但极易受对抗攻击;而基于CNN的模型则表现出相反特性。因此,本文通过集成模型策略,在自然与对抗双重威胁下实现更广覆盖与更高可靠性。
原文摘要 · Abstract (English)
The robustness of deep neural networks is a crucial factor in safety-critical applications, particularly in complex and dynamic environments (e.g., medical or driving scenarios) where localized corruptions can arise. While previous studies have evaluated the robustness of semantic segmentation (SS) models under whole-image natural or adversarial corruptions, a comprehensive investigation into the spatial robustness of dense vision models under localized corruptions remains underexplored. This paper fills this gap by introducing novel, region-aware metrics for benchmarking the spatial robustness of segmentation models, along with an evaluation framework to assess the impact of natural localized corruptions. Furthermore, it uncovers the inherent complexity of evaluating worst-case spatial robustness using only a single localized adversarial attack. To address this, the work proposes a region-aware multi-attack adversarial analysis to systematically assess model robustness across specific image regions. The proposed metrics and analysis were exploited to evaluate 14 segmentation models in driving scenarios, uncovering key insights into the effects of localized corruption in both natural and adversarial forms. The results reveal that models respond to these two types of threats differently; for instance, transformer-based segmentation models demonstrate notable robustness to localized natural corruptions but are highly vulnerable to adversarial ones, and vice versa for CNN-based models. Consequently, we also address the challenge of balancing robustness to both natural and adversarial localized corruptions by means of ensemble models, thereby achieving a broader threat coverage and improved reliability for dense vision tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。