针对视频模型设计更精准的鲁棒性验证方法,提升安全性保障效率。
Hybrid Robustness Verification for Spatio-Temporal Neural Networks

- 将攻击限制在时空局部区域,避免传统全域扰动的过度保守
- 提出STBP框架,在首层计算精确边界,后续层用高效近似
- 在自动驾驶和动作识别任务中实现1.7倍更高的认证鲁棒准确率
随着人工智能在安全关键系统中的广泛应用,为底层模型提供形式化鲁棒性保证至关重要。现有验证方法或依赖过度保守的近似,或带来难以承受的计算开销。例如,视频场景中使用lp-范数扰动假设攻击者可对每一帧注入噪声,但实际攻击具有结构化的时空相关性,局限于低维、语义有意义的子空间。本文研究处理视频与体数据的3D CNN的鲁棒性验证,面向动作识别(UCF-101)、自动驾驶(Udacity)和医学影像(MedMNIST)应用,通过建模时空约束——攻击者仅能修改部分连续帧中的子区域——引入更现实的攻击假设。我们证明该设定可实现更紧致的逼近。提出时空边界传播(STBP)框架,对第一卷积层计算精确闭式表征,并在后续层采用可扩展近似进行边界传播。精确计算首层边界以获得最紧界,其余网络使用近似方法。为推动该领域发展,我们构建了ST-Bench基准,用于系统评估自动驾驶与动作识别任务的可验证鲁棒性。相比现有方法,STBP在相同扰动预算下实现了更强的鲁棒性保证与显著提升的可扩展性,认证鲁棒准确率提高1.7倍。
原文摘要 · Abstract (English)
With AI increasingly deployed in safety-critical systems, providing formal robustness guarantees for the underlying models is essential. Existing verification methods either rely on overly conservative approximations or incur prohibitive computational costs. For example, the use of lp-norm perturbations in video settings encodes the belief that the adversary can inject noise in every video frame. In practice, adversarial perturbations exhibit structured spatial and temporal correlations, constrained to lower-dimensional, semantically meaningful subspaces. In this work, we study robustness verification of 3D CNNs processing video and volumetric inputs, targeting applications in action recognition (UCF-101), autonomous driving (Udacity), and medical imaging (MedMNIST) exploiting realistic assumptions on adversarial strength by modelling them as spatio-temporal constraints - where the attacker can modify either a subset of frames or patches within a set of consecutive frames. We demonstrate that modelling realistic constraints enables tighter approximations. We introduce Spatio-Temporal Bound Propagation (STBP), a verification framework that computes an exact closed-form characterization of the first convolutional layer and propagates certified bounds through subsequent layers using scalable approximations. Computing the exact closed form provides the tightest bounds for the first convolutional layer. Thus, we utilise approximation methods in the remainder of the network. To spur further progress in this field, we propose ST-Bench, a verification benchmark for autonomous driving and activity recognition, to systematically evaluate verifiable robustness. Compared to existing verification-based approaches, STBP provides stronger robustness guarantees with significantly improved scalability, achieving 1.7x higher certified robust accuracy under identical perturbation budgets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。