arXiv:2509.25788cs.LG2025-09被引 1

用几何预训练提升神经算子,少样本下也能更准解物理方程。

From Cheap Geometry to Expensive Physics: Elevating Neural Operators via Latent Shape Pretraining

  • 先用几何数据预训练编码器,学出能表征形状的隐空间
  • 再用预训练的隐变量代替点云输入,使算子在少量标注数据下表现更好
  • 适用于工业设计中物理模拟成本高、标签数据少的场景

工业设计评估常依赖高保真偏微分方程(PDE)仿真,但计算成本高,难以密集探索设计空间。神经算子虽可加速求解预测,却受限于物理标注数据稀缺。而大量仅含几何信息的设计方案易得却未被利用。本文提出两阶段框架:第一阶段,用几何重建任务在无标签数据上预训练自编码器,学习表达性强的隐空间表示;第二阶段,以预训练的隐嵌入作为输入,采用标准监督方式训练神经算子预测PDE解。两个阶段均使用基于Transformer的架构处理点云数据,实现无缝集成。在四个PDE数据集和三种主流Transformer神经算子上,本方法均显著优于直接使用原始点云输入的模型,证明了无物理标签的几何预训练能为数据高效算子学习提供强大基础。

原文摘要 · Abstract (English)

Industrial design evaluation often relies on high-fidelity simulations of governing partial differential equations (PDEs). While accurate, these simulations are computationally expensive, making dense exploration of design spaces impractical. Operator learning has emerged as a promising approach to accelerate PDE solution prediction; however, its effectiveness is often limited by the scarcity of labeled physics-based data. At the same time, large numbers of geometry-only candidate designs are readily available but remain largely untapped. We propose a two-stage framework to better exploit this abundant, physics-agnostic resource and improve supervised operator learning under limited labeled data. In Stage 1, we pretrain an autoencoder on a geometry reconstruction task to learn an expressive latent representation without PDE labels. In Stage 2, the neural operator is trained in a standard supervised manner to predict PDE solutions, using the pretrained latent embeddings as inputs instead of raw point clouds. Transformer-based architectures are adopted for both the autoencoder and the neural operator to handle point cloud data and integrate both stages seamlessly. Across four PDE datasets and three state-of-the-art transformer-based neural operators, our approach consistently improves prediction accuracy compared to models trained directly on raw point cloud inputs. These results demonstrate that representations from physics-agnostic pretraining provide a powerful foundation for data-efficient operator learning.

神经算子几何预训练数据效率PDE求解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。