arXiv:2603.00377cs.LG2026-03

大模型+合理缩放,让地震反演在复杂地质中表现飞跃

Improving Full Waveform Inversion in Large Model Era

  • 用大规模模型配合数据与训练策略协同扩展,突破小模型局限
  • 在6个复杂地质基准上SSIM从0.5844提升至0.7669,显著提升泛化能力
  • 适合地震成像、石油勘探等领域,尤其关注真实地质结构建模的研究者

全波形反演(FWI)是一个高度非线性且不适定的问题,旨在从地表记录的地震波形数据中恢复地下速度分布。现有数据驱动的FWI方法多依赖小型模型,因可用数据集体积有限、地质多样性不足、空间范围窄,存在严重过拟合风险。尽管在合成数据上表现良好,当前方法难以推广至更真实的地质结构。本文表明,仅在模拟且相对简单的数据上训练的大规模模型,仍能出色泛化至复杂且未见过的地质基准。我们提出一种协同扩展三轴(模型容量、数据多样性、训练策略)的可行方案,使百亿参数模型成功应用于FWI。该模型在OpenFWI上达到当前最优性能,并显著缩小了数据驱动FWI的泛化差距。在包括Marmousi、2D SEG/EAGE盐丘与逆冲、2004 BP、Sigsbee及SEAM Phase I在内的六个挑战性地质基准上,模型成功推断出训练集中不存在的复杂构造,性能显著提升(SSIM由0.5844增至0.7669)。结果表明,通过恰当的缩放策略,基于简单合成数据训练的大模型可在复杂真实地质结构中实现强泛化。

原文摘要 · Abstract (English)

Full Waveform Inversion (FWI) is a highly nonlinear and ill-posed problem that aims to recover subsurface velocity maps from surface-recorded seismic waveforms data. Existing data-driven FWI typically uses small models, as available datasets have limited volume, geological diversity, and spatial extent, leading to substantial concerns about overfitting. Although they perform well on synthetic datasets, current methods fail to generalize to more realistic geological structures. In this work, we show that a model trained entirely on simulated and relatively simple data can generalize remarkably well to challenging and unseen geological benchmarks. We provide a working recipe that tames a billion-parameter model for FWI through coordinated scaling across three axes: model capacity, data diversity, and training strategy. Our model achieves state-of-the-art performance on OpenFWI and significantly narrows the generalization gap in data-driven FWI. Across six challenging geophysical benchmarks, including Marmousi, 2D SEG/EAGE Salt and Overthrust, 2004 BP, Sigsbee, and SEAM Phase I, it infers complex structures absent from the training set and delivers significant performance improvements (SSIM from 0.5844 to 0.7669). Overall, our results demonstrate that with an appropriate scaling strategy, large models trained on simple synthetic data can achieve substantial generalization to more complex and realistic geological structures.

地震反演大模型泛化能力深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。