arXiv:2510.13025cs.LGcs.SY2025-10被引 3

用信息论平衡可压缩性与表达力,提升动力系统表示的稳定性与可解释性。

Information Shapes Koopman Representation

  • 引入信息理论拉格朗日框架,显式权衡简化与表达力
  • 降低隐变量互信息可抑制模式坍缩,提升多样性
  • 适用于需要稳定、可解释动力系统建模的研究者

Koopman算子为建模动态系统提供了强大框架,但其无限维特性使深度架构中有限维子空间的选择极具挑战。本文认为问题根源在于表征学习不佳:潜在变量未能平衡表达力与简洁性。这一矛盾与信息瓶颈困境密切相关——需构建既紧凑又具预测性的压缩表征。从该视角重思Koopman学习,我们发现潜在互信息促进简洁性,但过度强调简洁性会导致潜空间坍缩至少数主导模式;而冯·诺伊曼熵维持表达力,防止坍缩并促进模式多样性。据此提出信息理论拉格朗日形式化方法,显式平衡此权衡。进一步设计基于该形式的新算法,实现表征的稳定与可解释。通过可视化所学流形,实证结果与理论预测一致。在多种动态系统上验证,优于现有方法。代码公开于 https://github.com/Wenxuan52/InformationKoopman。

原文摘要 · Abstract (English)

The Koopman operator provides a powerful framework for modeling dynamical systems and has attracted growing interest from the machine learning community. However, its infinite-dimensional nature makes identifying suitable finite-dimensional subspaces challenging, especially for deep architectures. We argue that these difficulties come from suboptimal representation learning, where latent variables fail to balance expressivity and simplicity. This tension is closely related to the information bottleneck (IB) dilemma: constructing compressed representations that are both compact and predictive. Rethinking Koopman learning through this lens, we demonstrate that latent mutual information promotes simplicity, yet an overemphasis on simplicity may cause latent space to collapse onto a few dominant modes. In contrast, expressiveness is sustained by the von Neumann entropy, which prevents such collapse and encourages mode diversity. This insight leads us to propose an information-theoretic Lagrangian formulation that explicitly balances this tradeoff. Furthermore, we propose a new algorithm based on the Lagrangian formulation that encourages both simplicity and expressiveness, leading to a stable and interpretable Koopman representation. Beyond quantitative evaluations, we further visualize the learned manifolds under our representations, observing empirical results consistent with our theoretical predictions. Finally, we validate our approach across a diverse range of dynamical systems, demonstrating improved performance over existing Koopman learning methods. The implementation is publicly available at https://github.com/Wenxuan52/InformationKoopman.

动态系统信息瓶颈表征学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。