adversarial训练让鸟类声音分类模型在环境变化下更稳定、更准确
Adversarial Training Improves Generalization Under Distribution Shifts in Bird Sound Classification
- 用输出空间和嵌入空间对抗攻击训练模型,提升鲁棒性
- 在BirdSet数据集上,准确率最高提升10.5%(相对)
- 适合关注音频分类鲁棒性的研究者和生态监测应用
对抗训练虽能增强模型对对抗攻击的鲁棒性,但其在音频分类中面对显著分布偏移时的泛化能力仍不明确。本文以多标签鸟类声音分类任务为场景,比较了两种架构:ConvNeXt(强基准CNN)与AudioProtoPNet(基于原型的可解释模型)。实验基于生物声学挑战数据集BirdSet,该数据集因设备与环境差异导致显著协变量偏移。研究对比了输出空间攻击(最大化分类损失)与嵌入空间攻击(最大化嵌入差异),并用于训练与评估。对于AudioProtoPNet,还考察了原型在定向嵌入攻击下的稳定性。结果表明,尤其是输出空间对抗训练,使模型在干净测试数据上的均值cmAP相对提升最高达10.5%,同时增强了对抗鲁棒性。这些发现表明,对抗训练在复杂音频分类任务中具有提升抗分布偏移与对抗攻击能力的潜力。
原文摘要 · Abstract (English)
Adversarial training is a promising strategy for enhancing robustness against adversarial attacks, but its impact on generalization under substantial distribution shifts in audio classification remains largely unexplored. We address this gap by investigating how adversarial training strategies improve generalization performance and adversarial robustness in audio classification. We study two architectures for multi-label bird sound classification: ConvNeXt, a strong Convolutional Neural Network (CNN) baseline, and AudioProtoPNet, a prototype-based model that has demonstrated state-of-the-art performance while providing inherent interpretability through learned prototypes. Experiments use BirdSet, a challenging benchmark for bird sound classification in bioacoustics. Bioacoustic recordings exhibit substantial covariate shift due to heterogeneous recording devices and acoustic environments. We compare adversarial training based on output-space attacks, which maximize classification loss, and embedding-space attacks, which maximize embedding dissimilarity. Both attack types are also used for robustness evaluation. Additionally, for AudioProtoPNet, the study assesses the stability of its learned prototypes under targeted embedding-space attacks. Results show that adversarial training, particularly using output-space attacks, improves clean test-data performance by up to 10.5% relative in mean cmAP and simultaneously strengthens the adversarial robustness of the models. These findings, although derived from the bird sound domain, suggest that adversarial training holds potential to enhance robustness against both strong distribution shifts and adversarial attacks in challenging audio classification settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。