通过模型投影实现卷积与前馈网络间的高效参数迁移。
Inheritance Between Feedforward and Convolutional Networks via Model Projection
- 提出节点级统一框架,证明卷积网络包含前馈网络
- 投影后卷积模型可继承前馈结构,支持高效微调
- 在ImageNet下游任务中性能媲美主流方法
神经网络技术常通过类比在不同架构间迁移,但仅当技术假设被保留时才有效。本文提出模型类别间的继承概念。基于张量值激活的统一节点级框架,证明广义前馈网络(GFFNs)是广义卷积网络(GCNNs)的严格子集,因此GCNN性质可直接传递至GFFNs。反向传递不自动成立:标准CNN节点使用空间核,而FFN节点每个输入贡献仅用一个标量权重。为此引入模型投影:冻结每个卷积输入通道子函数,学习每个输入-输出通道贡献的标量系数,使投影后的CNN节点具备标量加权输入重组的GFFN式可训练结构。该继承结构自然带来参数高效迁移学习。在多个ImageNet预训练的CNN骨干网络和下游图像分类数据集上,模型投影表现媲美标准及PEFT基线,并为后续全量微调提供有效初始化。
原文摘要 · Abstract (English)
Neural-network techniques are often transferred across architecture families by analogy, but such transfer is valid only when the assumptions required by a technique are preserved. We introduce this idea as inheritance between model classes. Using a unified node-level framework with tensor-valued activations, we prove that generalized feedforward networks (GFFNs) form a strict subset of generalized convolutional networks (GCNNs), so GCNN properties transfer directly to GFFNs. The reverse direction is not automatic: standard CNN nodes use spatial kernels, while FFN nodes use one scalar weight per input contribution. We introduce model projection to recover a restricted reverse inheritance path. Projection freezes each convolutional input-channel sub-function and learns one scalar coefficient for each input-output channel contribution, giving projected CNN nodes the GFFN-style trainable structure of scalar-weighted input recombination. This inherited structure leads naturally to parameter-efficient transfer learning. Across multiple ImageNet-pretrained CNN backbones and downstream image-classification datasets, model projection is competitive with standard and PEFT baselines and provides an effective initialization for subsequent full fine-tuning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。