arXiv:2410.19746physics.comp-phcs.AI2024-10ICLR被引 8

用神经网络当优化器,让物理模拟又快又准。

Metamizer: a versatile neural optimizer for fast and accurate physics simulations

  • 用可缩放架构的神经网络替代传统优化器,自适应加速求解过程。
  • 在多种偏微分方程上达到接近机器精度的准确率,部分场景误差低于1e-8。
  • 训练后能泛化到未见过的方程,无需重新训练,适合工程与影视仿真应用。

高效的物理模拟对视频游戏中的布料动画、环境科学中的污染物扩散分析以及工程中车辆阻力系数计算等应用至关重要。然而,物理方程的解析解罕见,数值解又需要大量计算资源。近年来基于深度学习的物理模拟虽提升了效率,但泛化能力有限且精度低于传统数值求解器。本文提出 Metamizer,一种新型神经优化器,通过最小化基于物理的损失函数,迭代求解各类物理系统。该方法采用尺度不变架构,增强梯度下降更新,加速收敛。由于神经网络本身充当优化器,其训练属于元优化范式。实验表明,Metamizer 在训练过的拉普拉斯方程、对流-扩散方程、不可压缩纳维-斯托克斯方程及布料模拟基础上,对多种偏微分方程实现了前所未有的高精度,部分情况逼近机器精度(误差低于1e-8)。尤为突出的是,模型还能泛化至训练未覆盖的泊松方程、波动方程和伯格斯方程。结果表明,Metamizer 可能深刻影响未来数值求解器,实现无需重训的快速精准神经物理模拟。

原文摘要 · Abstract (English)

Efficient physics simulations are essential for numerous applications, ranging from realistic cloth animations or smoke effects in video games, to analyzing pollutant dispersion in environmental sciences, to calculating vehicle drag coefficients in engineering applications. Unfortunately, analytical solutions to the underlying physical equations are rarely available, and numerical solutions require high computational resources. Latest developments in the field of physics-based Deep Learning have led to promising efficiency improvements but still suffer from limited generalization capabilities and low accuracy compared to numerical solvers. In this work, we introduce Metamizer, a novel neural optimizer that iteratively solves a wide range of physical systems with high accuracy by minimizing a physics-based loss function. To this end, our approach leverages a scale-invariant architecture that enhances gradient descent updates to accelerate convergence. Since the neural network itself acts as an optimizer, training this neural optimizer falls into the category of meta-optimization approaches. We demonstrate that Metamizer achieves unprecedented accuracy for deep learning based approaches - sometimes approaching machine precision - across multiple PDEs after training on the Laplace, advection-diffusion and incompressible Navier-Stokes equation as well as on cloth simulations. Remarkably, the model also generalizes to PDEs that were not covered during training such as the Poisson, wave and Burgers equation. Our results suggest that Metamizer could have a profound impact on future numerical solvers, paving the way for fast and accurate neural physics simulations without the need for retraining.

物理模拟神经优化器偏微分方程元学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。