arXiv:2605.09016cs.AIcs.LG2026-05

用自学习坐标图谱提升神经微分方程求解效率与精度

CATO: Charted Attention for Neural PDE Operators

论文配图:CATO: Charted Attention for Neural PDE Operators
图 1 · 摘自论文原文
  • 将网格点映射到可学习的连续坐标图谱,用轴向注意力捕捉长程依赖
  • 在多个数据集上比最强基线平均提升26.76%,参数量减少81.98%
  • 适合需要高精度、低计算开销的复杂几何微分方程求解场景

神经算子已成为强大的数据驱动型微分方程(PDE)求解器,相比传统数值方法显著加速。然而,现有基于Transformer的算子在处理复杂几何时仍面临挑战:直接在大量网格点上进行计算代价高,而在原始离散坐标下操作又可能掩盖物理相互作用更自然表达的内在几何结构。为此,我们提出图谱轴向神经算子(CATO),一种适用于一般几何的几何自适应、导数感知神经算子。CATO不直接在物理坐标系中施加注意力,而是学习一个连续的潜在图谱,将网格坐标映射到学习后的图谱空间,在该空间中通过图谱条件轴向注意力高效捕捉长程依赖,降低计算成本。此外,CATO引入导数感知物理损失,联合监督稳态PDE的解值、网格一致梯度及辅助通量场,提升物理保真度并减少过平滑。我们进一步提供理论逼近结果表明,在良好图谱下,图谱轴向注意力可以受控误差表示低秩轴向解算子,且小图谱扰动导致的逼近退化有界。CATO在所有评估数据集上表现最优,平均优于最强基线约26.76%,同时参数量减少81.98%。这些结果凸显了学习几何自适应图谱和导数感知物理监督在准确高效学习PDE算子中的有效性。

原文摘要 · Abstract (English)

Neural operators have emerged as powerful data-driven solvers for PDEs, offering substantial acceleration over classical numerical methods. However, existing transformer-based operators still face critical challenges when modeling PDEs on complex geometries: directly processing over massive mesh points is computationally expensive, while operating in raw discretization coordinates may obscure the intrinsic geometry where physical interactions are more naturally expressed. To address these limitations, we introduce the Charted Axial Transformer Operator (CATO), a geometry-adaptive and derivative-aware neural operator for PDEs on general geometries. Instead of applying attention directly in the physical coordinate system, CATO learns a continuous latent chart that maps mesh coordinates into a learned chart space, where chart-conditioned axial attention efficiently captures long-range dependencies with reduced computational cost. In addition, CATO introduces a derivative-aware physics loss for steady-state PDEs that jointly supervises solution values, mesh-consistent gradients, and an auxiliary flux-like field, improving physical fidelity and reducing oversmoothing. We further provide a theoretical approximation result showing that, under a favorable chart, charted axial attention can represent low-rank axial solution operators with controlled error, and that small chart perturbations induce bounded approximation degradation. CATO achieves the best performance across all evaluated datasets, yielding an average improvement of approximately 26.76\% over the strongest competing baselines while reducing the number of parameters by 81.98\%. These results highlight the effectiveness of learning geometry-adaptive charts and derivative-aware physical supervision for accurate and efficient PDE operator learning.

神经算子微分方程几何建模注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。