arXiv:2606.23838cs.LGastro-ph.IM2026-06

自动发现并化解参数冗余,让复杂模型更易训练和解释。

The Degeneracy Distillery

论文配图:The Degeneracy Distillery
图 1 · 摘自论文原文
  • 通过分析似然函数的信息几何,自动识别参数间的不可区分组合。
  • 在合成与真实数据上验证,使仿真次数减少最多10倍,同时提升模型可解释性。
  • 适合需要简化复杂模型、优化仿真效率的物理建模与机器学习研究者。

当两个或多个参数或标签产生相似数据时,它们即为退化(degenerate),难以区分。这种退化使标签预测和逆问题求解变得困难,因为机器学习算法和概率采样器依赖于数据及其梯度对参数的可区分性。然而,在物理模型或真实数据集中识别退化现象,有助于理解模型选择或数据生成机制。本文提出退化蒸馏器(Degeneracy Distillery),仅需参数-数据(或参数-模拟)对,即可自动且符号化地检测并解决退化参数组合,方法基于费舍尔信息矩阵的估计与平坦化。通过探索似然函数的信息几何,我们将退化视为物理模型的内在属性,无需实际观测数据。我们在一系列合成与真实世界问题中验证该方法,发现了能分离独立影响的符号坐标变换。新坐标在整体上期望平坦化费舍尔信息矩阵,不同于仅在单点平坦化的后验方法,显著降低下游神经后验估计所需的仿真预算。测试案例中,实现相同校准精度时仿真次数最多减少10倍,并获得系统层面的物理洞察。

原文摘要 · Abstract (English)

When two or more parameters or labels produce similar data, they are degenerate, or hard to distinguish. Degeneracies render both label prediction and inverse problems difficult, since both machine learning algorithms and probabilistic samplers rely on the distinguishability of data and its gradients with respect to parameters. However, identifying degeneracies in physical models or real-world datasets can be elucidating about the choice of model or the underlying process that produces the data. We present the degeneracy distillery, a method that (1) detects and (2) resolves degenerate parameter combinations (a) automatically and (b) symbolically, from parameter-data (or parameter-simulation) pairs alone, through estimation and flattening of the Fisher information matrix. By exploring the information geometry of the likelihood, we characterize degeneracies as an intrinsic property of the physical model, requiring no realised data observation. We demonstrate our approach on a range of synthetic and real-world problems, discovering symbolic coordinate transformations that identify the combinations of parameters of a model which yield independent effects on the data. The resulting coordinates flatten the Fisher information in expectation globally, in contrast to posterior-based methods that flatten only at a single point, and substantially reduce the simulation budget required for downstream neural posterior estimation. In test cases we require up to $10\times$ fewer simulations for posterior estimation at matched validation calibration whilst simultaneously gaining physical insight on the system.

模型简化信息几何仿真优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。