让大模型的微调技能跨架构迁移,无需重新训练。
Activation Manifold Projection: Liberating Task-Specific Behaviors from LLM Architectures
- 通过激活空间映射,直接转换不同模型间的微调行为。
- 跨架构迁移后性能达原模型的85%-95%,超越现有方法。
- 适合希望复用微调成果的开发者和研究者使用。
大型语言模型(LLM)架构的多样化带来了根本性挑战:通过低秩适配(LoRA)等微调方法学习到的任务特定行为被锁定在原始模型架构中,即所谓‘架构锁定’。现有迁移方法试图通过对齐静态权重空间来弥合差距,但该方法脆弱且间接,依赖于参数几何间的松散关联。本文提出一种全新范式——卡匣激活空间迁移(CAST),通过学习两个不同LLM架构之间激活流形(激活形成的几何结构)的非线性映射,直接解放由LoRA编码的行为。将预训练的LoRA视为固定的‘行为内核’,通过轻量级双向投影头,将目标模型的激活映射至源模型的潜在空间,应用冻结的内核后,再映射回目标空间。该过程仅需通用文本语料训练,不依赖任务数据,实现技能与源架构解耦。实验表明,CAST可实现任意标准LoRA的真正‘零样本’迁移,在异构模型族如Llama-2与Mistral间迁移时,性能达到完全重训LoRA的85%-95%,显著优于现有权重空间迁移技术,建立模型互操作性新基准。
原文摘要 · Abstract (English)
The proliferation of Large Language Model (LLM) architectures presents a fundamental challenge: valuable, task-specific behaviors learned through fine-tuning methods like Low-Rank Adaptation (LoRA) are effectively trapped within their source model's architecture, herein referred to architectural lock-in. Existing transfer methods attempt to bridge this gap by aligning the static weight spaces of models, a brittle and indirect approach that relies on tenuous correlations between parameter geometries. This paper introduces a fundamentally different and more direct paradigm: the Cartridge Activation Space Transfer (CAST), a novel framework that liberates LoRA-encoded behaviors by learning a direct, nonlinear mapping between the activation manifolds, the geometric structures formed by the model's internal neuron activations, of two distinct LLM architectures. CAST treats a pre-trained LoRA as a frozen "behavioral kernel." It learns a set of lightweight, bidirectional projection heads that translate the target model's activation stream into the source model's latent space, apply the frozen kernel, and project the result back. This process, trained on a general text corpus without any task-specific data, effectively decouples the learned skill from the source architecture. We demonstrate that CAST enables true "zero-shot" translation of any standard LoRA adapter. Our experiments, including transfers between heterogeneous model families like Llama-2 and Mistral, show that CAST-translated adapters achieve 85-95\% of the performance of a LoRA fully retrained on the target model, quantitatively outperforming current weight-space transfer techniques and establishing a new state-of-the-art in model interoperability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。