揭示张量网络模型的理论极限,证明其泛化能力有根本性约束。
No-Free-Lunch Theories for Tensor-Network Machine Learning Models
- 基于矩阵乘积态和投影纠缠对态,建立张量网络学习的无免费午餐定理。
- 通过多面体拼图组合方法,突破二维伊辛模型配分函数计算难题。
- 为量子启发机器学习提供可分析的理论框架,适合研究模型边界者。
张量网络机器学习模型在处理复杂数据任务方面表现出色,涵盖量子多体问题到经典模式识别。尽管性能优异,其基本假设与局限性仍缺乏系统理解。本文致力于严谨推导张量网络机器学习模型的无免费午餐定理——这一问题对特定模型而言极具挑战性。我们首先针对基于矩阵乘积态(一维张量网络状态)的模型证明了该定理;随后,为克服二维伊辛模型中配分函数计算困难,引入与“多面体拼图”相关的组合方法,成功建立了投影纠缠对态(二维)情形下的无免费午餐定理。结果揭示了张量网络学习模型在理论上固有的限制,为未来量子启发式机器学习框架的优劣分析开辟了新路径。
原文摘要 · Abstract (English)
Tensor network machine learning models have shown remarkable versatility in tackling complex data-driven tasks, ranging from quantum many-body problems to classical pattern recognitions. Despite their promising performance, a comprehensive understanding of the underlying assumptions and limitations of these models is still lacking. In this work, we focus on the rigorous formulation of their no-free-lunch theorem -- essential yet notoriously challenging to formalize for specific tensor network machine learning models. In particular, we rigorously analyze the generalization risks of learning target output functions from input data encoded in tensor network states. We first prove a no-free-lunch theorem for machine learning models based on matrix product states, i.e., the one-dimensional tensor network states. Furthermore, we circumvent the challenging issue of calculating the partition function for two-dimensional Ising model, and prove the no-free-lunch theorem for the case of two-dimensional projected entangled-pair state, by introducing the combinatorial method associated to the "puzzle of polyominoes". Our findings reveal the intrinsic limitations of tensor network-based learning models in a rigorous fashion, and open up an avenue for future analytical exploration of both the strengths and limitations of quantum-inspired machine learning frameworks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。