用函数空间扩散模型生成符合物理规律的连续数据
FunDiff: Diffusion Models over Function Spaces for Physics-Informed Generative Modeling
- 将扩散模型与函数自编码器结合,处理不同离散化的连续函数
- 生成的函数可在任意位置评估,且满足基本物理定律
- 适合流体动力学、固体力学等需物理约束的生成任务
生成建模的最新进展——尤其是扩散模型和流匹配——在图像、视频等离散数据合成方面取得了显著成果。然而,将其应用于物理场景仍具挑战性,因为关注量是受复杂物理定律支配的连续函数。本文提出一种名为FunDiff的新框架,用于函数空间中的生成建模。FunDiff结合潜在扩散过程与函数自编码器架构,可处理具有不同离散化的输入函数,生成可在任意位置求值的连续函数,并无缝融入物理先验。这些先验通过结构约束或物理信息损失函数实现,确保生成样本满足基本物理定律。我们从理论上建立了函数空间密度估计的极小极大最优性保证,表明在合适正则条件下,基于扩散的估计器能达到最优收敛速率。我们在流体动力学与固体力学等多个应用中验证了FunDiff的实际有效性。实验结果表明,该方法生成的样本具有高保真度且符合物理规律,对噪声和低分辨率数据表现出强鲁棒性。代码与数据集已公开于 https://github.com/sifanexisted/fundiff。
原文摘要 · Abstract (English)
Recent advances in generative modeling -- particularly diffusion models and flow matching -- have achieved remarkable success in synthesizing discrete data such as images and videos. However, adapting these models to physical applications remains challenging, as the quantities of interest are continuous functions governed by complex physical laws. Here, we introduce $\textbf{FunDiff}$, a novel framework for generative modeling in function spaces. FunDiff combines a latent diffusion process with a function autoencoder architecture to handle input functions with varying discretizations, generate continuous functions evaluable at arbitrary locations, and seamlessly incorporate physical priors. These priors are enforced through architectural constraints or physics-informed loss functions, ensuring that generated samples satisfy fundamental physical laws. We theoretically establish minimax optimality guarantees for density estimation in function spaces, showing that diffusion-based estimators achieve optimal convergence rates under suitable regularity conditions. We demonstrate the practical effectiveness of FunDiff across diverse applications in fluid dynamics and solid mechanics. Empirical results show that our method generates physically consistent samples with high fidelity to the target distribution and exhibits robustness to noisy and low-resolution data. Code and datasets are publicly available at https://github.com/sifanexisted/fundiff.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。