arXiv:2605.28007cs.LGcs.AI2026-05

提出向量网络,让模型像拼积木一样组合权重,实现灵活重用。

Learning Compositional Latent Structure with Vector Networks

论文配图:Learning Compositional Latent Structure with Vector Networks
图 1 · 摘自论文原文
  • 用可复用的秩1权重原子替代固定权重矩阵,按需组合。
  • 在新组合任务上,分布外误差降低约一个数量级。
  • 适合需要灵活重组知识的场景,如复杂结构泛化。

深度网络虽强大,但通常将多种计算共享于同一权重矩阵中,导致难以选择性复用或调整部分结构。本文提出向量网络(Vector Network, VN),一种分层递归架构,每层用可复用的秩1权重原子库替代固定权重矩阵。对每个输入,VN通过最小化局部能量,推断出一组稀疏激活的权重原子及其系数,同时受自底向上输入重建与自顶向下反馈一致性约束。这些系数共同构成该样本特有的低秩权重矩阵。收敛后,仅通过局部残差信号以系数为缩放因子更新选定的权重原子。在四个组合性基准上评估:一维信号、二维空间解码、N体动力学和组合式MNIST。VN在分布内表现媲美强基线,而在熟悉因素以新方式重组时,分布外误差通常降低约一个数量级。因此,向量网络使组合泛化成为架构与推理过程的结构性特征,而非依赖共享密集参数的脆弱产物。

原文摘要 · Abstract (English)

Deep networks are powerful function approximators, but they typically store many different computations in shared weight matrices, making it difficult to selectively reuse or adapt parts of them when a familiar structure appears in novel combinations. We introduce the Vector Network (VN), a hierarchical recurrent architecture in which each layer replaces a fixed weight matrix with a library of reusable rank-1 weight atoms. For each input, VN minimizes a layer-local energy to infer a sparse set of active weight atoms and their coefficients, jointly constrained by bottom-up input reconstruction and top-down feedback consistency. These weight atom coefficients then compose an input-specific low-rank weight matrix for that sample. After convergence, slow learning updates only the selected weight atoms through local residual signals scaled by the inferred coefficients. We evaluate VN on four compositional benchmarks spanning 1D signals, 2D spatial decoding, N-body dynamics, and compositional MNIST. VN matches strong baselines in distribution while often achieving out-of-distribution error about an order of magnitude lower when familiar factors must be recombined in novel ways. Vector networks thus make compositional generalization a structural property of the architecture and inference process rather than a brittle byproduct of fitting many behaviors into one shared dense parameter substrate.

神经网络组合泛化权重复用稀疏结构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。