提出首个骨骼动作识别的迁移攻击方法,提升对抗样本泛化能力。
TASAR: Transfer-based Attack on Skeletal Action Recognition

- 通过平滑损失函数增强对抗样本迁移性
- 在多个数据集上实现超80%攻击成功率
- 适合研究模型鲁棒性与防御机制的学者
骨骼序列作为人体动作识别的常用表示,近年来面临对抗攻击威胁。现有骨骼动作识别(S-HAR)攻击普遍存在迁移能力弱的问题,且原因尚不明确。本文通过分析损失函数特性发现,低平滑性是导致迁移性差的关键因素。基于此,提出首个针对骨骼动作识别的迁移攻击方法TASAR:利用新提出的双贝叶斯优化策略对预训练代理模型进行后训练,获得更平滑的模型后验;同时引入运动动态建模,破坏动作的时空一致性。为全面评估,构建首个大规模鲁棒性基准,涵盖7个S-HAR模型、10种攻击方法、3个数据集和2种防御模型。实验表明TASAR在多数场景下攻击成功率超过80%,显著优于现有方法。代码已开源,便于后续研究。
原文摘要 · Abstract (English)
Skeletal sequence data, as a widely employed representation of human actions, are crucial in Human Activity Recognition (HAR). Recently, adversarial attacks have been proposed in this area, which exposes potential security concerns, and more importantly provides a good tool for model robustness test. Within this research, transfer-based attack is an important tool as it mimics the real-world scenario where an attacker has no knowledge of the target model, but is under-explored in Skeleton-based HAR (S-HAR). Consequently, existing S-HAR attacks exhibit weak adversarial transferability and the reason remains largely unknown. In this paper, we investigate this phenomenon via the characterization of the loss function. We find that one prominent indicator of poor transferability is the low smoothness of the loss function. Led by this observation, we improve the transferability by properly smoothening the loss when computing the adversarial examples. This leads to the first Transfer-based Attack on Skeletal Action Recognition, TASAR. TASAR explores the smoothened model posterior of pre-trained surrogates, which is achieved by a new post-train Dual Bayesian optimization strategy. Furthermore, unlike existing transfer-based methods which overlook the temporal coherence within sequences, TASAR incorporates motion dynamics into the Bayesian attack, effectively disrupting the spatial-temporal coherence of S-HARs. For exhaustive evaluation, we build the first large-scale robust S-HAR benchmark, comprising 7 S-HAR models, 10 attack methods, 3 S-HAR datasets and 2 defense models. Extensive results demonstrate the superiority of TASAR. Our benchmark enables easy comparisons for future studies, with the code available in the https://github.com/yunfengdiao/Skeleton-Robustness-Benchmark.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。