揭示微调时表征变化为何集中在输出层附近
Decomposing the Depth Profile of Fine-Tuning
- 通过逐层控制梯度幅度,验证变化分布受架构和规模影响
- 125M-350M模型中,串行块结构始终保留变化斜率,平行块仅在语言建模任务中保留
- 模型规模达1.3B以上后,两类架构表现趋同,说明深度依赖规模与任务
微调将预训练网络适配到新目标。表征变化的深度分布是模型内在特性还是梯度流动大小所致,尚未直接验证。我们对15种模型(4类架构:编码器/解码器Transformer、状态空间模型、RNN)在125M至6.9B参数规模下共240次微调运行进行了测量。几乎所有标准训练中,表征变化集中于靠近输出的层,仅一处例外。通过每步优化后控制各层$"|ΔW\/Wf|"$相等,发现该分布部分条件下仍存在,部分则消失。在125M–350M规模下,串行块结构(BERT、OPT、GPT-2)在所有任务中保持正斜率,而并行块结构(Pythia、CodeGen)仅在因果语言建模任务中保留;1.3B–1.4B规模下,两类架构均在因果语言建模任务中呈现正等步斜率。标准训练中,分布形状由两个额外因素决定:陡度反映初始化时与目标任务的距离,宽度主要由架构决定。将局部梯度(表征变化的深度斜率)视为复合现象,其成分随模型规模变化。
原文摘要 · Abstract (English)
Fine-tuning adapts pretrained networks to new objectives. Whether the resulting depth profile of representational change reflects an intrinsic property of the model or the magnitude of gradient flow has not been tested directly. We measure this profile across 240 fine-tuning runs spanning 15 models in four architecture families (encoder and decoder transformers, a state-space model, and an RNN) at scales from 125M to 6.9B parameters. Representational change concentrates in output-proximal layers in every standard-training run except one. We apply a per-layer control that equalizes $\|ΔW\|/\|W\|$ across layers after each optimizer step. Under this control, the profile persists in some conditions and collapses in others. At 125M--350M, sequential-block architectures (BERT, OPT, GPT-2) retain the slope across tested objectives while parallel-block architectures (Pythia, CodeGen) retain it only for causal-language-modeling objectives. This architectural distinction narrows at 1.3B--1.4B, where both block types show positive equal-step slopes for CausalLM. Under standard training, profile shape is described by two additional axes: steepness tracks a training-free objective distance at initialization, and profile width is dominated by architecture. We treat the locality gradient, the depthwise slope of representational change, as a composite phenomenon whose components are scale-dependent.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。