arXiv:2504.16130eess.SPcs.AI2025-04被引 14

用自监督方法让拉曼光谱无需标注数据也能精准识别物质

A Self-supervised Learning Method for Raman Spectroscopy based on Masked Autoencoders

  • 通过掩码自编码器重建被遮蔽的光谱,无须标注数据预训练
  • 重建后信噪比提升两倍以上,30类病原菌识别准确率超80%
  • 少量标注数据微调后性能媲美监督模型,适合标注稀缺场景

拉曼光谱是分析物质化学信息的强大工具。将拉曼光谱与深度学习结合可实现材料的快速定性定量分析。现有方法多采用监督学习,虽精度较高,但受限于昂贵且稀缺的高质量标注光谱数据集。当标注困难或数据不足时,监督学习性能显著下降。为解决无标注光谱的特征提取难题,本文提出基于掩码自编码器的自监督学习框架SMAE。SMAE在预训练阶段无需任何光谱标注,通过随机遮蔽并重构光谱信息,学习关键谱图特征。重建过程具有一定的去噪效果,使信噪比提升超过两倍。利用预训练权重,SMAE在病原菌数据集上对30类孤立细菌实现超过80%的聚类准确率,显著优于传统无监督方法及其他先进深度聚类方法。在少量标注数据微调后,测试集识别准确率达83.90%,与监督型ResNet(83.40%)表现相当。

原文摘要 · Abstract (English)

Raman spectroscopy serves as a powerful and reliable tool for analyzing the chemical information of substances. The integration of Raman spectroscopy with deep learning methods enables rapid qualitative and quantitative analysis of materials. Most existing approaches adopt supervised learning methods. Although supervised learning has achieved satisfactory accuracy in spectral analysis, it is still constrained by costly and limited well-annotated spectral datasets for training. When spectral annotation is challenging or the amount of annotated data is insufficient, the performance of supervised learning in spectral material identification declines. In order to address the challenge of feature extraction from unannotated spectra, we propose a self-supervised learning paradigm for Raman Spectroscopy based on a Masked AutoEncoder, termed SMAE. SMAE does not require any spectral annotations during pre-training. By randomly masking and then reconstructing the spectral information, the model learns essential spectral features. The reconstructed spectra exhibit certain denoising properties, improving the signal-to-noise ratio (SNR) by more than twofold. Utilizing the network weights obtained from masked pre-training, SMAE achieves clustering accuracy of over 80% for 30 classes of isolated bacteria in a pathogenic bacterial dataset, demonstrating significant improvements compared to classical unsupervised methods and other state-of-the-art deep clustering methods. After fine-tuning the network with a limited amount of annotated data, SMAE achieves an identification accuracy of 83.90% on the test set, presenting competitive performance against the supervised ResNet (83.40%).

自监督学习拉曼光谱特征提取无监督识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。