arXiv:2502.19960cs.LG2025-02被引 11

用大语言模型跨模态迁移,让地震监测更准更快

SeisMoLLM: Advancing Seismic Monitoring via Cross-modal Transfer with Pre-trained Large Language Model

  • 将预训练语言模型通过波形编码迁移至地震任务
  • 在5项核心任务中36个指标领先,少样本泛化提升10%-50%
  • 无需地震数据预训练,效率优于轻量模型,适合实际部署

深度学习虽已革新地震监测,但构建能在多任务中表现优异且适应信号劣化或数据稀缺的通用模型仍具挑战。本文提出首个基于跨模态迁移的地震监测基础模型SeisMoLLM,利用大规模预训练语言模型(GPT-2)进行波形分词与微调,无需直接在地震数据上预训练即可实现卓越性能。在DiTing和STEAD数据集上的五项关键任务——背方位角估计、震中距估计、震级估计、相位拾取及初动极性分类中,共取得43个任务指标中的36项最佳结果,16项少样本泛化指标中获12项榜首,多数改进率达10%至50%。同时,其训练与推理效率与轻量模型相当甚至更优。该成果确立了SeisMoLLM作为实用地震监测基础模型的潜力,并凸显跨模态迁移在地震学研究中的新方向,展现了先进深度学习技术推动地震学发展的前景。

原文摘要 · Abstract (English)

Recent advances in deep learning have revolutionized seismic monitoring, yet developing a foundation model that performs well across multiple complex tasks remains challenging, particularly when dealing with degraded signals or data scarcity. This work presents SeisMoLLM, the first foundation model that utilizes cross-modal transfer for seismic monitoring, to unleash the power of large-scale pre-training from a large language model without requiring direct pre-training on seismic datasets. Through elaborate waveform tokenization and fine-tuning of pre-trained GPT-2 model, SeisMoLLM achieves state-of-the-art performance on the DiTing and STEAD datasets across five critical tasks: back-azimuth estimation, epicentral distance estimation, magnitude estimation, phase picking, and first-motion polarity classification. It attains 36 best results out of 43 task metrics and 12 top scores out of 16 few-shot generalization metrics, with many relative improvements ranging from 10% to 50%. In addition to its superior performance, SeisMoLLM maintains efficiency comparable to or even better than lightweight models in both training and inference. These findings establish SeisMoLLM as a promising foundation model for practical seismic monitoring and highlight cross-modal transfer as an exciting new direction for earthquake studies, showcasing the potential of advanced deep learning techniques to propel seismology research forward.

地震监测跨模态迁移大模型应用预训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。