用混合密度网络高效量化科学问题中的多模态不确定性
Multimodal Scientific Learning Beyond Diffusions and Flows
- 采用显式参数化密度估计的混合密度网络,适配低维多模态物理规律
- 在数据稀缺时仍能可靠恢复多个解分支,样本效率显著优于扩散模型
- 适合需要可解释性与小样本泛化的科学建模任务
科学机器学习(SciML)日益需要捕捉由不适定逆问题、多稳定性及混沌动力学引发的多模态条件不确定性。尽管近期研究多采用扩散和基于流的高表达隐式生成模型,但这些方法往往数据需求大、计算成本高,且与科学问题中常见的结构化解空间不匹配。本文表明,混合密度网络(MDNs)为SciML中的多模态不确定性量化提供了一种原理清晰却长期被忽视的替代方案。作为显式参数化密度估计器,MDNs具有针对低维、多模态物理的归纳偏置,能够直接在不同解分支间全局分配概率质量。该结构实现强数据效率,在科学数据稀缺的场景下仍能可靠恢复分离模式。我们通过统一的概率框架对比了显式与隐式分布网络,并实证证明:在一系列逆问题、多稳态和混沌科学回归任务中,MDNs在泛化能力、可解释性和样本效率方面均表现更优。
原文摘要 · Abstract (English)
Scientific machine learning (SciML) increasingly requires models that capture multimodal conditional uncertainty arising from ill-posed inverse problems, multistability, and chaotic dynamics. While recent work has favored highly expressive implicit generative models such as diffusion and flow-based methods, these approaches are often data-hungry, computationally costly, and misaligned with the structured solution spaces frequently found in scientific problems. We demonstrate that Mixture Density Networks (MDNs) provide a principled yet largely overlooked alternative for multimodal uncertainty quantification in SciML. As explicit parametric density estimators, MDNs impose an inductive bias tailored to low-dimensional, multimodal physics, enabling direct global allocation of probability mass across distinct solution branches. This structure delivers strong data efficiency, allowing reliable recovery of separated modes in regimes where scientific data is scarce. We formalize these insights through a unified probabilistic framework contrasting explicit and implicit distribution networks, and demonstrate empirically that MDNs achieve superior generalization, interpretability, and sample efficiency across a range of inverse, multistable, and chaotic scientific regression tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。