arXiv:2603.24343cs.SDcs.AI2026-03中稿 · IJCNN 2026

通过模拟脑神经可塑性,动态调整神经元数量提升深度伪造音频检测效率与准确率。

Enhancing Efficiency and Performance in Deepfake Audio Detection through Neuron-level Dropin & Neuroplasticity Mechanisms

  • 借鉴大脑神经可塑性,动态增减网络层神经元数量以灵活调节参数。
  • 在ASVSpoof2019等数据集上,误检率降低最多达66%。
  • 适用于多种模型架构,尤其适合资源受限场景下的高效检测。

当前音频深度伪造检测已借助ResNet等深度学习架构取得显著进展,并在引入Wav2Vec等大模型后进一步提升。大语言模型的成功表明扩大参数规模有益,但也暴露了性能受参数数量限制的瓶颈。现有方法通过堆叠更多层扩展模型,但计算成本高且需全量重训。此外,低秩适配方法主要应用于基于注意力的架构,适用范围有限。受哺乳动物大脑神经可塑性启发,我们提出全新算法Dropin与Plasticity,可动态调整特定层的神经元数量,灵活调控模型参数。我们在ResNet、门控循环神经网络及Wav2Vec等多种架构上进行了评估。实验结果基于ASVSpoof2019 LA、PA和FakeorReal数据集显示,Dropin方法显著提升计算效率,而Dropin与Plasticity方法分别实现最高约39%和66%的相对等错误率(Equal Error Rate)降低。代码与补充材料已公开于GitHub。

原文摘要 · Abstract (English)

Current audio deepfake detection has achieved remarkable performance using diverse deep learning architectures such as ResNet, and has seen further improvements with the introduction of large models (LMs) like Wav2Vec. The success of large language models (LLMs) further demonstrates the benefits of scaling model parameters, but also highlights one bottleneck where performance gains are constrained by parameter counts. Simply stacking additional layers, as done in current LLMs, is computationally expensive and requires full retraining. Furthermore, existing low-rank adaptation methods are primarily applied to attention-based architectures, which limits their scope. Inspired by the neuronal plasticity observed in mammalian brains, we propose novel algorithms, dropin and further plasticity, that dynamically adjust the number of neurons in certain layers to flexibly modulate model parameters. We evaluate these algorithms on multiple architectures, including ResNet, Gated Recurrent Neural Networks, and Wav2Vec. Experimental results using the widely recognised ASVSpoof2019 LA, PA, and FakeorReal dataset demonstrate consistent improvements in computational efficiency with the dropin approach and a maximum of around 39% and 66% relative reduction in Equal Error Rate with the dropin and plasticity approach among these dataset, respectively. The code and supplementary material are available at Github link.

深度伪造音频检测神经可塑性模型压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。