arXiv:2602.02117cs.LGcs.IT2026-02被引 4

用博弈论解释量子熵最大化,让机器学习更稳健

The Maximum von Neumann Entropy Principle: Theory and Applications in Machine Learning

  • 将最大量子熵扩展为博弈框架,适用于数据驱动场景
  • 在部分信息下仍能给出最不偏倚的谱域推断结果
  • 适合研究核方法与不确定性建模的学者参考

冯·诺依曼熵(VNE)是量子信息中的基础概念,近年来被用于衡量核矩阵和核协方差算子的谱多样性。尽管在量子系统中约束下的最大熵优化已有成熟理论,但在数据驱动场景下,尚未建立与经典最大熵原理对应的决策论和博弈论解释。本文将Grünwald和Dawid的极小极大形式化拓展至冯·诺依曼熵,为密度矩阵及迹归一化的半正定算子上的最大熵最大化提供了博弈论依据。该视角使部分信息下的最大熵解具有鲁棒解释,并揭示其作为谱域中最不承诺的推断本质。随后,通过两个代表性应用展示该原理在现代机器学习中的作用:基于核的冯·诺依曼熵最大化选择最优归一化嵌入表示;以及从部分观测数据中补全核矩阵。这些例子表明,所提框架为基于冯·诺依曼熵的方法提供了统一的信息论基础。

原文摘要 · Abstract (English)

Von Neumann entropy (VNE) is a fundamental quantity in quantum information theory and has recently been adopted in machine learning as a spectral measure of diversity for kernel matrices and kernel covariance operators. While maximizing VNE under constraints is well known in quantum settings, a principled analogue of the classical maximum entropy framework, particularly its decision theoretic and game theoretic interpretation, has not been explicitly developed for VNE in data driven contexts. In this paper, we extend the minimax formulation of the maximum entropy principle due to Grünwald and Dawid to the setting of von Neumann entropy, providing a game-theoretic justification for VNE maximization over density matrices and trace-normalized positive semidefinite operators. This perspective yields a robust interpretation of maximum VNE solutions under partial information and clarifies their role as least committed inferences in spectral domains. We then illustrate how the resulting Maximum VNE principle applies to modern machine learning problems by considering two representative applications, selecting a kernel representation from multiple normalized embeddings via kernel-based VNE maximization, and completing kernel matrices from partially observed entries. These examples demonstrate how the proposed framework offers a unifying information-theoretic foundation for VNE-based methods in kernel learning.

量子熵核方法信息论博弈论

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。