用物理重整化群思想自动搜索最优张量网络结构,速度快且压缩效果好。
Renormalization Group Guided Tensor Network Structure Search
- 通过多尺度连续演化寻找张量网络结构,避免离散搜索陷阱。
- 在光场数据等任务上实现最高压缩比,速度比现有方法快4-600倍。
- 适合需要高效高维数据压缩的研究者,尤其关注结构自动化设计。
张量网络结构搜索(TN-SS)旨在自动发现高维数据表示中高效的网络拓扑与秩配置。现有方法在计算可扩展性、结构自适应性和优化鲁棒性方面存在局限,主要受三大挑战制约:单尺度优化遗漏多尺度结构,离散搜索空间阻碍平滑演化,结构与参数分离优化导致效率低下。本文提出物理启发的RGTN框架,利用多尺度重整化群流实现张量网络结构搜索。不同于固定尺度的离散搜索,RGTN采用动态尺度变换支持连续结构演化。核心创新包括可学习边门用于优化阶段拓扑调整,以及基于物理量(如节点张力衡量局部应力、边信息流量化连通重要性)的智能提议机制。从低复杂度粗粒度尺度开始,逐步精细化,借助尺度诱导扰动跳出局部极小。在光场数据、高阶合成张量和视频补全任务上的大量实验表明,RGTN实现了当前最佳压缩比,运行速度较现有方法提升4至600倍,验证了该物理启发方法的有效性。
原文摘要 · Abstract (English)
Tensor network structure search (TN-SS) aims to automatically discover optimal network topologies and rank configurations for efficient tensor decomposition in high-dimensional data representation. Despite recent advances, existing TN-SS methods face significant limitations in computational tractability, structure adaptivity, and optimization robustness across diverse tensor characteristics. They struggle with three key challenges: single-scale optimization missing multi-scale structures, discrete search spaces hindering smooth structure evolution, and separated structure-parameter optimization causing computational inefficiency. We propose RGTN (Renormalization Group guided Tensor Network search), a physics-inspired framework transforming TN-SS via multi-scale renormalization group flows. Unlike fixed-scale discrete search methods, RGTN uses dynamic scale-transformation for continuous structure evolution across resolutions. Its core innovation includes learnable edge gates for optimization-stage topology modification and intelligent proposals based on physical quantities like node tension measuring local stress and edge information flow quantifying connectivity importance. Starting from low-complexity coarse scales and refining to finer ones, RGTN finds compact structures while escaping local minima via scale-induced perturbations. Extensive experiments on light field data, high-order synthetic tensors, and video completion tasks show RGTN achieves state-of-the-art compression ratios and runs 4-600$\times$ faster than existing methods, validating the effectiveness of our physics-inspired approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。