arXiv:2411.03668cs.SDeess.AS2024-11

通过跨尺度多层级特征学习,提升手机录音设备识别准确率。

Mobile Recording Device Recognition Based Cross-Scale and Multi-Level Representation Learning

  • 融合帧级与样本级特征,用ConvLSTM和BiLSTM捕捉短时与长时序列信息。
  • 在CCNU_Mobile数据集上达到99.6%准确率,比基线提升2%至12%。
  • 模型具备良好迁移能力,在新数据集上仍达87.9%准确率,适合实际部署。

本文提出一种基于跨尺度多层级表示学习的建模方法,结合短期帧级与长期样本级特征。浅层特征提取阶段采用多种尺度,包括梅尔频率倒谱系数(MFCC)和预处理后的对数能量谱。识别网络输入为二维时序特征,先用一维卷积门控循环单元(ConvLSTM)融合时空信息并提取短时帧级特征;再通过双向长短期记忆网络(BiLSTM)学习长期样本级序列表示;最后由变换器编码器对全局帧级与样本级特征进行跨尺度多层级处理,实现深层特征融合。最终通过Softmax输出识别结果。在CCNU_Mobile数据集上,该方法达到99.6%识别准确率,相较基线系统提升2%至12%。此外,我们还验证了模型的迁移能力,在新数据集上的分类任务中取得87.9%准确率。

原文摘要 · Abstract (English)

This paper introduces a modeling approach that employs multi-level global processing, encompassing both short-term frame-level and long-term sample-level feature scales. In the initial stage of shallow feature extraction, various scales are employed to extract multi-level features, including Mel-Frequency Cepstral Coefficients (MFCC) and pre-Fbank log energy spectrum. The construction of the identification network model involves considering the input two-dimensional temporal features from both frame and sample levels. Specifically, the model initially employs one-dimensional convolution-based Convolutional Long Short-Term Memory (ConvLSTM) to fuse spatiotemporal information and extract short-term frame-level features. Subsequently, bidirectional long Short-Term Memory (BiLSTM) is utilized to learn long-term sample-level sequential representations. The transformer encoder then performs cross-scale, multi-level processing on global frame-level and sample-level features, facilitating deep feature representation and fusion at both levels. Finally, recognition results are obtained through Softmax. Our method achieves an impressive 99.6% recognition accuracy on the CCNU_Mobile dataset, exhibiting a notable improvement of 2% to 12% compared to the baseline system. Additionally, we thoroughly investigate the transferability of our model, achieving an 87.9% accuracy in a classification task on a new dataset.

设备识别语音分析跨尺度学习深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。