arXiv:2501.18691cs.LGquant-ph2025-01被引 4

改进张量网络生成模型的二阶优化,提升训练稳定性和效率

Regularized second-order optimization of tensor-network Born machines

  • 在归一化态流形上使用带正则化的修正牛顿法
  • 收敛速度显著加快,避免陷入局部最优
  • 适合需要高效训练量子启发生成模型的研究者

张量网络玻恩机(TNBMs)是受量子启发的生成模型,用于学习数据分布。通过张量网络收缩与优化技术,模型能以紧凑参数化捕捉复杂相关性。然而,其优化面临挑战:常用损失函数具有对数形式,单张量优化无法解析求解,需迭代方法,导致收敛慢且易陷于多个非最优局部极小值。本文提出一种改进的二阶优化技术,显著提升TNBM训练的收敛速度和模型质量。方法在归一化态流形上采用修正牛顿法,并引入损失景观正则化以缓解局部极小问题。我们在一维矩阵乘积态(MPS)上对离散和连续数据集进行训练,验证了该方法在稳定性与效率上的优势,展示了其作为鲁棒、可扩展的量子启发生成模型优化方案的潜力。

原文摘要 · Abstract (English)

Tensor-network Born machines (TNBMs) are quantum-inspired generative models for learning data distributions. Using tensor-network contraction and optimization techniques, the model learns an efficient representation of the target distribution, capable of capturing complex correlations with a compact parameterization. Despite their promise, the optimization of TNBMs presents several challenges. A key bottleneck of TNBMs is the logarithmic nature of the loss function commonly used for this problem. The single-tensor logarithmic optimization problem cannot be solved analytically, necessitating an iterative approach that slows down convergence and increases the risk of getting trapped in one of many non-optimal local minima. In this paper, we present an improved second-order optimization technique for TNBM training, which significantly enhances convergence rates and the quality of the optimized model. Our method employs a modified Newton's method on the manifold of normalized states, incorporating regularization of the loss landscape to mitigate local minima issues. We demonstrate the effectiveness of our approach by training a one-dimensional matrix product state (MPS) on both discrete and continuous datasets, showcasing its advantages in terms of stability and efficiency, and demonstrating its potential as a robust and scalable approach for optimizing quantum-inspired generative models.

生成模型张量网络二阶优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。