arXiv:2506.19051eess.IVcs.CV2025-06被引 1

开源工具箱评测神经图像压缩的抗攻击能力,揭示模型脆弱性与鲁棒性差异。

NIC-RobustBench: A Comprehensive Open-Source Toolkit for Neural Image Compression and Robustness Analysis

  • 整合8种攻击、9种防御策略,统一评估压缩模型鲁棒性
  • 发现部分编码架构在对抗攻击下重建失真超30%,下游任务准确率下降超40%
  • 适合研究图像压缩安全性的学者与工业界开发者使用

神经图像压缩(NIC)在计算机视觉流程中日益普及,基于学习的模型在压缩效率上已超越传统算法。然而,学习型编码器可能不稳定且易受对抗攻击:微小扰动可导致严重重建伪影或间接破坏下游模型。尽管存在这些风险,现有大多数NIC基准仅关注率失真(RD)性能,聚焦于非对抗场景下的模型效率,而鲁棒性研究仅覆盖特定编码器和攻击方式。为填补这一空白,我们提出 extbf{NIC-RobustBench},一个开源的神经图像压缩对抗鲁棒性评估框架。该基准集成8种攻击、9种防御策略、标准的RD指标、大量可扩展的编码器,以及评估压缩模型鲁棒性及对下游任务影响的工具。利用 NIC-RobustBench,我们对现代NICs和防御策略在对抗场景下的表现进行了广泛实证研究,揭示了失效模式、最脆弱与最鲁棒的架构,并获得关于NIC鲁棒性的其他关键洞察。代码已公开于 https://github.com/msu-video-group/NIC-RobustBench。

原文摘要 · Abstract (English)

Neural image compression (NIC) is increasingly used in computer vision pipelines, as learning-based models are able to surpass traditional algorithms in compression efficiency. However, learned codecs can be unstable and vulnerable to adversarial attacks: small perturbations may cause severe reconstruction artifacts or indirectly break downstream models. Despite these risks, most NIC benchmarks only emphasize rate-distortion (RD) performance, focusing on model efficiency in safe, non-adversarial scenarios, while NIC robustness studies cover only specific codecs and attacks. To fill this gap, we introduce \textbf{NIC-RobustBench}, an open-source benchmark and evaluation framework for adversarial robustness of NIC methods. The benchmark integrates 8 attacks, 9 defense strategies, standard RD metrics, a large and extensible set of codecs, and tools for assessing both the robustness of the compression model and impact on downstream tasks. Using NIC-RobustBench, we provide a broad empirical study of modern NICs and defenses in adversarial scenarios, highlighting failure modes, least and most resilient architectures, and other insights into NIC robustness. Our code is available online at https://github.com/msu-video-group/NIC-RobustBench.

图像压缩对抗鲁棒性评估框架开源工具

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。