arXiv:2505.23537cs.LGcs.CL2025-05被引 7

用大模型结合领域知识,高效搜索最优张量网络结构

Domain-Aware Tensor Network Structure Search

  • 引入领域知识指导大模型直接预测张量网络结构
  • 减少90%以上函数评估次数,性能接近顶尖算法
  • 可为其他方法提供高质量初始解,适合科研与工业应用

张量网络(TNs)能高效表示高维数据,但最优张量网络结构搜索(TN-SS)仍具挑战。现有最先进算法将问题视为纯数值优化,需大量函数评估,难以应用于真实场景。同时,这些方法忽略真实张量数据中的领域信息,且所生成结构缺乏可解释性。为此,我们提出tnLLM框架,融合数据领域知识并利用大语言模型(LLMs)的推理能力,直接预测合适张量网络结构。该框架包含领域感知提示流程,引导LLM基于张量模式间的实际关系推断结构。此方法不仅能迭代优化目标函数,还能生成领域相关的结构解释。实验表明,tnLLM在函数评估次数显著减少的情况下,达到与最先进算法相当的优化结果。此外,我们证明了由LLM提供的领域信息可用于为采样类最先进方法提供良好初始化,加速收敛过程,同时保持理论性能保证。

原文摘要 · Abstract (English)

Tensor networks (TNs) provide efficient representations of high-dimensional data, yet identification of the optimal TN structures, the so called tensor network structure search (TN-SS) problem, remains a challenge. Current state-of-the-art (SOTA) algorithms solve TN-SS as a purely numerical optimization problem and require extensive function evaluations, which is prohibitive for real-world applications. In addition, existing methods ignore the valuable domain information inherent in real-world tensor data and lack transparency in their identified TN structures. To this end, we propose a novel TN-SS framework, termed the tnLLM, which incorporates domain information about the data and harnesses the reasoning capabilities of large language models (LLMs) to directly predict suitable TN structures. The proposed framework involves a domain-aware prompting pipeline which instructs the LLM to infer suitable TN structures based on the real-world relationships between tensor modes. In this way, our approach is capable of not only iteratively optimizing the objective function, but also generating domain-aware explanations for the identified structures. Experimental results demonstrate that tnLLM achieves comparable TN-SS objective function values with much fewer function evaluations compared to SOTA algorithms. Furthermore, we demonstrate that the LLM-enabled domain information can be used to find good initializations in the search space for sampling-based SOTA methods to accelerate their convergence while preserving theoretical performance guarantees.

张量网络大模型结构搜索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。