arXiv:2608.10289cs.CVcs.LG2026-08

用自然语言测试视觉模型在语义变化下的鲁棒性,发现隐藏的故障触发因素。

SeFaR: Semantic Feature-aware Robustness Testing of Deep Neural Networks

论文配图:SeFaR: Semantic Feature-aware Robustness Testing of Deep Neural Networks
图 1 · 摘自论文原文
  • 基于语义概念分层建模,结合用户定义知识生成真实感扰动
  • 通过反馈自适应生成可解释的故障触发语义概念和测试样本
  • 适合安全关键场景下视觉模型的可靠性验证,尤其关注罕见场景

深度神经网络在安全关键领域作为感知模块广泛应用,其失效常源于罕见且低频出现的场景。这要求评估感知模型在真实感知变异下的语义鲁棒性,即行为是否符合高层需求。为此,我们提出SeFaR框架,实现视觉模型的系统性语义特征中心化测试。给定自然语言需求及满足该需求的输入集合,SeFaR评估模型在保持需求满足的前提下,对多样化真实语义变化的鲁棒性。该方法采用新颖的分层概念模型,支持特征空间的结构化探索,并通过用户定义的概念融入领域知识。利用先进的扩散模型与视觉-语言模型生成保语义的真实感扰动,并识别影响模型行为的未知特征。采用反馈驱动的自适应流程,生成可解释的故障诱导语义概念及其对应测试输入。案例研究验证了该框架在满足需求前提的同时,能识别出影响决策的非需求相关特征,从而有效发现缺陷并关联至具体特征。

原文摘要 · Abstract (English)

Deep neural networks are increasingly deployed in safety-critical domains as perception modules, where failures are often caused due to rare and under-represented scenarios. This necessitates the need to evaluate the semantic robustness of perception models; conformance of behavior to high-level requirements over real-world perceptual variability. To address this, we propose SeFaR, a framework for systematic semantic-feature-centric testing of vision models. Given a natural-language requirement and a set of satisfying inputs, SeFaR evaluates robustness with respect to diverse realistic semantic variations that preserve requirement satisfaction. The approach employs a novel hierarchical concept model enabling structured exploration of the feature space and incorporation of domain knowledge via user-defined concepts. State-of-the-art diffusion and vision-language models are leveraged to generate photorealistic semantics-preserving perturbations and identification of previously unknown features impacting behavior. A feedback-driven adaptive process is adopted to generate interpretable failure-inducing semantic concepts along with corresponding test inputs. Evaluation on case studies demonstrates that the proposed framework effectively satisfies requirement preconditions while identifying requirement-independent features that influence model decisions, enabling it to both uncover faults and relate them to such features.

模型测试语义鲁棒性视觉模型生成对抗

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。