用物理约束的Transformer模型,高效准确反演地震波速剖面。
DispFormer: A Pretrained Transformer Incorporating Physical Constraints for Dispersion Curve Inversion
- 基于Transformer独立处理各周期数据,无需对齐训练测试集
- 零样本下反演结果优于初始参考模型,少样本时超越传统方法
- 适合无标签或少量标注数据的地震勘探场景
地表波频散曲线反演对估算地下剪切波速(vs)至关重要,但传统方法存在计算成本高、解不唯一及对初值敏感等问题。深度学习虽有潜力,但多数需大量标注数据,且难以应对实际数据中周期范围变化、缺失值和信噪比低等问题。本文提出DispFormer,一种基于Transformer的神经网络,用于从瑞利波相速度和群速度频散曲线反演vs剖面。该模型在每个周期上独立处理数据,可适应不同长度输入,无需网络调整或严格对齐训练测试集。引入深度感知训练策略,融入频散数据深度敏感性的物理约束。DispFormer在全局合成数据上预训练,通过零样本和少样本策略在两个区域合成数据集上评估。结果表明,即使无标注数据,零样本下的DispFormer生成的反演剖面也优于预训练所用的插值参考模型,可作为传统流程的可部署初值生成器。当有部分标注数据时,少样本训练的DispFormer性能超越传统全局搜索方法。真实数据测试进一步验证其对不同长度数据的良好泛化能力,并实现更低的数据残差。这些发现表明DispFormer具有作为频散曲线反演基础模型的潜力,展示了物理信息深度学习在地球物理应用中的优势。
原文摘要 · Abstract (English)
Surface wave dispersion curve inversion is crucial for estimating subsurface shear-wave velocity (vs), yet traditional methods often face challenges related to computational cost, non-uniqueness, and sensitivity to initial models. While deep learning approaches show promise, many require large labeled datasets and struggle with real-world datasets, which often exhibit varying period ranges, missing values, and low signal-to-noise ratios. To address these limitations, this study introduces DispFormer, a transformer-based neural network for $v_s$ profile inversion from Rayleigh-wave phase and group dispersion curves. DispFormer processes dispersion data independently at each period, allowing it to handle varying lengths without requiring network modifications or strict alignment between training and testing datasets. A depth-aware training strategy is also introduced, incorporating physical constraints derived from the depth sensitivity of dispersion data. DispFormer is pre-trained on a global synthetic dataset and evaluated on two regional synthetic datasets using zero-shot and few-shot strategies. Results show that even without labeled data, the zero-shot DispFormer generates inversion profiles that outperform the interpolated reference model used as the pretraining target, providing a deployable initial model generator to assist traditional workflows. When partial labeled data available, the few-shot trained DispFormer surpasses traditional global search methods. Real-world tests further confirm that DispFormer generalizes well to dispersion data with varying lengths and achieves lower data residuals than reference models. These findings underscore the potential of DispFormer as a foundation model for dispersion curve inversion and demonstrate the advantages of integrating physics-informed deep learning into geophysical applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。