arXiv:2410.09250cs.SDcs.AI2024-10被引 33

用量子训练卷积网络,减少70%参数量仍保持高精度检测假音频。

Quantum-Trained Convolutional Neural Network for Deepfake Audio Detection

  • 混合量子-经典架构,通过量子态提升模型表达力。
  • 相比传统模型参数减少70%,测试准确率保持高水平。
  • 适合资源受限场景,为抗深度伪造提供高效新方案。

深度伪造技术的兴起对隐私、安全和信息真实性构成了严峻挑战,尤其在音频与多媒体内容领域。本文提出一种量子训练卷积神经网络(QT-CNN)框架,利用量子机器学习(QML)的计算优势,增强深度伪造音频的检测能力。该方法采用量子-经典混合架构,将量子神经网络(QNN)与经典神经网络结合,优化训练效率并减少可训练参数。创新性地引入量子到经典参数映射机制,有效利用量子态提升模型表达力,在不牺牲准确率的前提下实现最高达70%的参数压缩。数据预处理包括提取关键音频特征、标签编码、特征缩放及构建序列化数据集,以支持稳健评估。实验表明,QT-CNN在不同QNN模块配置下均达到与传统CNN相当的性能,训练与测试阶段均保持高准确率。该框架在降低计算开销的同时维持优异表现,展现出在深度伪造检测及其他资源受限场景中的应用潜力。本研究验证了量子计算融入人工智能的实际价值,提供了一种可扩展、高效的深度伪造检测新路径。

原文摘要 · Abstract (English)

The rise of deepfake technologies has posed significant challenges to privacy, security, and information integrity, particularly in audio and multimedia content. This paper introduces a Quantum-Trained Convolutional Neural Network (QT-CNN) framework designed to enhance the detection of deepfake audio, leveraging the computational power of quantum machine learning (QML). The QT-CNN employs a hybrid quantum-classical approach, integrating Quantum Neural Networks (QNNs) with classical neural architectures to optimize training efficiency while reducing the number of trainable parameters. Our method incorporates a novel quantum-to-classical parameter mapping that effectively utilizes quantum states to enhance the expressive power of the model, achieving up to 70% parameter reduction compared to classical models without compromising accuracy. Data pre-processing involved extracting essential audio features, label encoding, feature scaling, and constructing sequential datasets for robust model evaluation. Experimental results demonstrate that the QT-CNN achieves comparable performance to traditional CNNs, maintaining high accuracy during training and testing phases across varying configurations of QNN blocks. The QT framework's ability to reduce computational overhead while maintaining performance underscores its potential for real-world applications in deepfake detection and other resource-constrained scenarios. This work highlights the practical benefits of integrating quantum computing into artificial intelligence, offering a scalable and efficient approach to advancing deepfake detection technologies.

深度伪造量子计算音频检测模型压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。