arXiv:2509.03191cs.LG2025-09被引 7

用表格大模型预测土体强度与填补缺失参数,效率更高且更准。

Tabular foundation model for GEOAI benchmark problems BM/AirportSoilProperties/2/2025

  • 基于Transformer的表格基础模型,零训练直接推理。
  • 空间强度预测准确率更高,推理快10倍;参数填补误差更低。
  • 适合地质建模、工程勘察领域,尤其数据少时效果显著。

本文首次将基于Transformer的表格基础模型TabPFN应用于地基工程基准问题BM/AirportSoilProperties/2/2025。针对两个任务:(1) 预测钻孔深度上不排水抗剪强度(su)的空间变化;(2) 在密集场地数据集中填补缺失力学参数。采用零训练、少量样本、上下文学习设置,结合大型间接数据库(BID)提供额外信息。结果表明,相较于传统分层贝叶斯模型(HBM),TabPFN在预测精度和不确定性校准方面表现更优,且推理效率提升一个数量级。在问题1中,其预测精度更高,运行时间快10倍;在问题2中,所有目标参数的RMSE均更低,不确定性量化更可靠,尽管因逐变量推理导致总计算成本略高。这是首个成功应用表格基础模型于岩土建模的研究,预示概率化场地评估的新范式。

原文摘要 · Abstract (English)

This paper presents a novel application of the Tabular Prior-Data Fitted Network (TabPFN) - a transformer-based foundation model for tabular data - to geotechnical site characterization problems defined in the GEOAI benchmark BM/AirportSoilProperties/2/2025. Two tasks are addressed: (1) predicting the spatial variation of undrained shear strength (su) across borehole depth profiles, and (2) imputing missing mechanical parameters in a dense-site dataset. We apply TabPFN in a zero-training, few-shot, in-context learning setting - without hyper-parameter tuning - and provide it with additional context from the big indirect database (BID). The study demonstrates that TabPFN, as a general-purpose foundation model, achieved superior accuracy and well-calibrated predictive distributions compared to a conventional hierarchical Bayesian model (HBM) baseline, while also offering significant gains in inference efficiency. In Benchmark Problem #1 (spatial su prediction), TabPFN outperformed the HBM in prediction accuracy and delivered an order-of-magnitude faster runtime. In Benchmark Problem #2 (missing mechanical parameter imputation), TabPFN likewise achieved lower RMSE for all target parameters with well-quantified uncertainties, though its cumulative computation cost was higher than HBM's due to its one-variable-at-a-time inference. These results mark the first successful use of a tabular foundation model in geotechnical modeling, suggesting a potential paradigm shift in probabilistic site characterization.

表格模型岩土工程零样本学习不确定性量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。