arXiv:2510.03320cs.CRcs.LG2025-10中稿 · "7th OVERLAY" work…

通过验证概念逻辑关系提升模型抗攻击能力,更符合人类对安全的直觉。

Attack logics, not outputs: Towards efficient robustification of deep neural networks by falsifying concept-based properties

  • 用可解释AI技术在已训练模型上构建可验证的概念逻辑规则
  • 攻击目标从类别翻转扩展到逻辑矛盾,如红+八边形≠停车标志
  • 理论表明该方法搜索空间更小,适合同时提升模型逻辑一致性和鲁棒性

计算机视觉中的深度神经网络易受对抗攻击,即微小恶意输入扰动可引发不合理输出。现有方法主要通过破坏最终类别输出(如将'停车标志'误判为非停车标志)来验证和缓解鲁棒性问题。本文提出将攻击目标拓展至更具语义意义的概念逻辑约束,例如:红 ∧ 八边形 → 停车标志。利用可解释人工智能技术,可在不重新训练的情况下实现对这类概念属性的快速建模与攻击。理论上,针对概念逻辑的攻击搜索空间小于单纯类别翻转,且更契合人类对模型行为合理性的直觉判断。展望未来,该方法有望高效同步提升模型的逻辑一致性与对抗鲁棒性。

原文摘要 · Abstract (English)

Deep neural networks (NNs) for computer vision are vulnerable to adversarial attacks, i.e., miniscule malicious changes to inputs may induce unintuitive outputs. One key approach to verify and mitigate such robustness issues is to falsify expected output behavior. This allows, e.g., to locally proof security, or to (re)train NNs on obtained adversarial input examples. Due to the black-box nature of NNs, current attacks only falsify a class of the final output, such as flipping from $\texttt{stop_sign}$ to $\neg\texttt{stop_sign}$. In this short position paper we generalize this to search for generally illogical behavior, as considered in NN verification: falsify constraints (concept-based properties) involving further human-interpretable concepts, like $\texttt{red}\wedge\texttt{octogonal}\rightarrow\texttt{stop_sign}$. For this, an easy implementation of concept-based properties on already trained NNs is proposed using techniques from explainable artificial intelligence. Further, we sketch the theoretical proof that attacks on concept-based properties are expected to have a reduced search space compared to simple class falsification, whilst arguably be more aligned with intuitive robustness targets. As an outlook to this work in progress we hypothesize that this approach has potential to efficiently and simultaneously improve logical compliance and robustness.

对抗攻击逻辑验证可解释AI鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。