arXiv:2606.18923cs.LG2026-06

让神经网络结构可编程,像编辑代码一样动态调整连接与模块。

GrapNet: A Programmable Dynamic-Architecture Neural Graph Substrate

论文配图:GrapNet: A Programmable Dynamic-Architecture Neural Graph Substrate
图 1 · 摘自论文原文
  • 用可编程图结构替代固定架构,节点自主管理下一跳连接和可训练分配向量。
  • 在相同条件下,比传统模型提升12.08个百分点准确率,显著优于参数更大的MLP。
  • 适合需要动态修改网络结构的场景,如持续学习、可解释性研究或模块化设计。

可编程性是固定张量神经网络中缺失的一等接口:修改关系、冻结子图、审计局部函数或更换执行后端,应是对神经程序的操作,而非临时的参数调整。GrapNet研究以图作为网络架构和可执行程序的设定。图即为架构与程序,非输入数据图。每个计算节点拥有其下一层子节点引用及对齐的可训练分配向量;删除一条关系将物理移除对应子引用和分配坐标。结构规则与执行策略位于节点核心之外,因此同一子节点拥有的图可被扩展、冻结、结构化编辑、分组为可训练块、通过注意力路由活跃关系,或在拓扑稳定后降为密集快照。GrapNet通过向量值父接口与传统模块组合:全连接层、CNN编码器、ResNet特征提取器、注意力模块和Transformer表示均可按每坐标一个感知节点接入。评估采用可编程性压力测试,而非新回放基准。在匹配的十种子分裂Fashion-MNIST实验中,可塑的GrapNet+ER头达到63.16%已见类准确率,远超参数更大的密集MLP+ER(51.08%),差值达12.08点,p=1.3e-5。在冻结ImageNet ResNet-18编码器的Split CIFAR-10上,相同基底使在线头部优于MLP-256达3.81点,p=0.0026。结果支持GrapNet作为可编辑神经图基底,其核心价值在于结构可编程性与忠实执行视图。

原文摘要 · Abstract (English)

Programmability is a missing first-class interface in fixed-tensor neural networks: editing a relation, freezing a subgraph, auditing a local function, or changing the execution backend should be an operation on the neural program rather than ad-hoc parameter surgery. GrapNet studies this graph-as-network setting. The graph is the architecture and executable program, not an input data graph. Each compute node owns its next-layer child references and a trainable allocation vector aligned with those references; deleting a relation physically removes both the child reference and the corresponding allocation coordinate. Structural rules and execution policies live outside the node core, so the same child-owned graph can be grown, frozen, structurally edited, grouped into trainable family blocks, routed by attention over active relations, or lowered to dense snapshots after topology stabilizes. GrapNet composes with conventional modules through a vector-valued parent interface: dense layers, CNN encoders, ResNet feature extractors, attention blocks, and transformer representations can all feed one sensory GrapNode per coordinate. The evaluation is organized as a programmability stress suite rather than as a new replay benchmark. In a matched ten-seed Split Fashion-MNIST study, a plastic GrapNet+ER head reaches 63.16 percent seen-class accuracy versus 51.08 percent for a parameter-larger dense MLP+ER under the same seen-class loss and replay memory, with paired delta 12.08 points and p=1.3e-5. On Split CIFAR-10 with a frozen ImageNet ResNet-18 encoder, the same substrate improves the online head over MLP-256 by 3.81 points, with p=0.0026. These results support GrapNet as an editable neural graph substrate whose core value is structural programmability with faithful execution views.

可编程神经网络动态图结构持续学习神经架构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。