根据物理复杂度动态调整神经PDE求解器的精度,提升效率与性能。
Adaptive Mesh-Quantization for Neural PDE Solvers
- 按空间复杂度自适应分配量化位宽,高难度区域用更高精度
- 在4个不同物理任务上实现相同计算成本下最高50%性能提升
- 轻量辅助模型识别难点区域,适合追求高效高精度的仿真研究者
物理系统常表现出空间上变化的复杂性,对神经PDE求解器构成挑战。尽管图神经网络可处理复杂几何与边界条件所需的不规则网格,但仍对所有节点施加相同的计算开销,导致简单区域与复杂现象获得同等资源,造成效率低下。本文提出自适应网格量化:对网格节点、边和簇特征进行空间自适应量化,动态调整量化模型所用的位宽。我们设计了一种由轻量级辅助模型驱动的自适应位宽分配策略,用于识别输入网格中的高损失区域。该机制使主模型能动态分配资源,复杂区域使用更高位宽,从而优化计算资源利用。我们在两种先进模型——MP-PDE与GraphViT上集成该框架,评估了多项任务的表现:2D Darcy流、大规模非稳态二维流体动力学、三维稳态Navier-Stokes模拟以及2D超弹性问题。结果表明,本框架在各项任务中均优于均匀量化基线,实现一致的帕累托改进,在相同成本下性能最高提升50%。
原文摘要 · Abstract (English)
Physical systems commonly exhibit spatially varying complexity, presenting a significant challenge for neural PDE solvers. While Graph Neural Networks can handle the irregular meshes required for complex geometries and boundary conditions, they still apply uniform computational effort across all nodes regardless of the underlying physics complexity. This leads to inefficient resource allocation where computationally simple regions receive the same treatment as complex phenomena. We address this challenge by introducing Adaptive Mesh Quantization: spatially adaptive quantization across mesh node, edge, and cluster features, dynamically adjusting the bit-width used by a quantized model. We propose an adaptive bit-width allocation strategy driven by a lightweight auxiliary model that identifies high-loss regions in the input mesh. This enables dynamic resource distribution in the main model, where regions of higher difficulty are allocated increased bit-width, optimizing computational resource utilization. We demonstrate our framework's effectiveness by integrating it with two state-of-the-art models, MP-PDE and GraphViT, to evaluate performance across multiple tasks: 2D Darcy flow, large-scale unsteady fluid dynamics in 2D, steady-state Navier-Stokes simulations in 3D, and a 2D hyper-elasticity problem. Our framework demonstrates consistent Pareto improvements over uniformly quantized baselines, yielding up to 50% improvements in performance at the same cost.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。