arXiv:2606.28416cs.CVcs.AI2026-06

用语义感知与不确定性建模,提升视觉传感器中对抗样本的检测能力。

AEGIS: A Semantic GAN and Evidential Learning Frameworkfor Robust Adversarial Detection in Vision Sensors

论文配图:AEGIS: A Semantic GAN and Evidential Learning Frameworkfor Robust Adversarial Detection in Vision Sensors
图 1 · 摘自论文原文
  • 先用语义GAN识别视觉不一致的对抗图像,再通过随机增强提取多维度不稳定性特征。
  • 在Tiny ImageNet上对六类攻击检测达到92.1%的AUROC和90.7%准确率。
  • 输出带校准置信度的预测,适合对安全性要求高的视觉系统部署。

深度神经网络在视觉传感器网络中表现优异,但易受对抗性干扰和难以察觉的扰动影响,导致错误分类。本文提出AEGIS框架,一种面向视觉传感器管道的鲁棒图像分类对抗检测方法。核心包含语义生成对抗网络(SemanticGAN)模块,作为多类别语义判别器,在输入传播前识别并过滤视觉不一致的对抗样本。通过随机增强生成测试时变化,计算手写不稳定性指标:翻转分数(FlipScore)、预测不一致性、早期与中期层的层间余弦相似度及熵值,整合为五维紧凑向量。该向量由证据深度学习(EDL)分类器处理,使用狄利克雷分布建模输出证据,同时提供类别预测与校准后的不确定性估计。在包含六类攻击(正常、FGSM、PGD、贴片攻击、功能型、几何攻击)的Tiny ImageNet数据集上评估,AEGIS实现92.1%的AUROC、90.2%的AUPRC与90.7%的准确率,优于传统softmax基线检测器,在检测性能、鲁棒性、可解释性与不确定性校准方面均表现更优。

原文摘要 · Abstract (English)

Deep neural networks (DNNs) have shown outstanding performance in visual recognition tasks within vision sensor networks; however, they are still vulnerable to adversarial manipulations and imperceptible perturbations that can lead to erroneous predictions. To address that, this paper presents AEGIS, a semantic aware and uncertainty guided adversarial detection framework designed for robust image classification in vision sensors pipelines. At its core, a SemantiGAN module functions as a multi class semantic discriminator, identifying and filtering visually inconsistent adversarial inputs before they propagate further in the pipeline. For inputs that pass this stage, a stochastic augmentation process generates test time variations, from which handcrafted instability metrics FlipScore, Prediction Inconsistency, Layerwise Cosine Similarity (early and mid layers), and Entropy are computed. These features are aggregated into a compact five dimensional vector and processed by an Evidential Deep Learning (EDL) classifier, which models output evidence using a Dirichlet distribution to yield both class predictions and calibrated uncertainty estimates. Evaluations on the Tiny ImageNet dataset across six categories clean, FGSM, PGD, patch based, functional, and geometric attacks demonstrate the effectiveness of AEGIS. The proposed framework achieves an AUROC of 92.1\%, an AUPRC of 90.2\%, and an accuracy of 90.7\%, outperforming conventional softmax-based detectors in terms of detection performance, robustness, interpretability, and uncertainty calibration.

对抗检测视觉传感器证据学习不确定性建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。