发现大模型跨尺度参数迁移存在神经不相容性,难以直接传递知识。
Neural Incompatibility: The Unbridgeable Gap of Cross-Scale Parametric Knowledge Transfer in Large Language Models
- 提出预对齐参数迁移(PrePKT)新范式,减少微调成本。
- 实验证明跨规模模型参数迁移稳定性差,存在根本性障碍。
- 揭示模型规模差异导致的结构不兼容,适合研究高效迁移的学者。
大型语言模型(LLMs)具备可访问的参数,蕴含丰富知识,便于分析与迁移。因此,突破传统符号化知识转移范式,实现真正的参数化知识迁移(PKT)成为关键挑战。本文首次证明参数空间对齐是实现跨尺度PKT的基本前提。将以往知识迁移重定义为后对齐PKT(PostPKT),需微调以实现对齐;为降低后续微调成本,提出新型预对齐PKT(PrePKT)范式,并引入LaTen方法,在无需后续训练的情况下仅通过少量训练步骤即可对齐不同规模模型的参数空间。在四个基准测试上的实验表明,PostPKT与PrePKT均难以实现稳定迁移。深入分析揭示,模型规模差异带来的神经与参数结构差异构成‘神经不相容性’,成为有效PKT的根本障碍。该研究为理解LLM参数架构提供了新视角,指明了高效参数迁移的未来方向。代码已开源。
原文摘要 · Abstract (English)
Large Language Models (LLMs) offer a transparent brain with accessible parameters that encode extensive knowledge, which can be analyzed, located and transferred. Consequently, a key research challenge is to transcend traditional knowledge transfer paradigms rooted in symbolic language and achieve genuine Parametric Knowledge Transfer (PKT). Significantly, exploring effective methods for transferring knowledge across LLMs of different scales through parameters presents an intriguing and valuable research direction. In this paper, we first demonstrate $\textbf{Alignment}$ in parametric space is the fundamental prerequisite to achieve successful cross-scale PKT. We redefine the previously explored knowledge transfer as Post-Align PKT (PostPKT), which utilizes extracted parameters for LoRA initialization and requires subsequent fine-tune for alignment. Hence, to reduce cost for further fine-tuning, we introduce a novel Pre-Align PKT (PrePKT) paradigm and propose a solution called $\textbf{LaTen}$ ($\textbf{L}$oc$\textbf{a}$te-$\textbf{T}$h$\textbf{e}$n-Alig$\textbf{n}$) that aligns the parametric spaces of LLMs across scales only using several training steps without following training. Comprehensive experiments on four benchmarks demonstrate that both PostPKT and PrePKT face challenges in achieving consistently stable transfer. Through in-depth analysis, we identify $\textbf{Neural Incompatibility}$ as the ethological and parametric structural differences between LLMs of varying scales, presenting fundamental challenges to achieving effective PKT. These findings provide fresh insights into the parametric architectures of LLMs and highlight promising directions for future research on efficient PKT. Our code is available at https://github.com/Trae1ounG/Neural_Incompatibility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。