不同语言模型的表征趋同,可实现高效线性对齐。
Characterizing Linear Alignment Across Language Models
- 通过仿射变换对齐独立训练模型的最终隐藏状态
- 线性对齐在文本生成等任务中保持性能,部分实现跨模型生成
- 适用于隐私保护的跨孤岛推理,延迟低于1秒
尽管训练目标、架构和数据模态各异,语言模型正逐渐学习到相似的表征。这种独立训练模型间的兼容性为下游目标的跨模型对齐带来新机遇,并拓展至安全、隐私或竞争限制下无法直接共享数据或模型的场景。本文研究大语言模型间表征收敛对实际线性对齐的影响。具体地,我们学习独立模型最终隐藏状态间的仿射变换,并在文本生成、嵌入分类和分布外检测任务上进行实证评估。结果表明,模型对间性能基本保持不变,并首次展示线性对齐可实现跨独立训练模型的文本生成。此外,我们提出一种基于线性对齐的隐私保护跨孤岛推理框架:在共享公开数据集上学习仿射变换,仅对线性分类操作使用同态加密,实现亚秒级推理延迟。
原文摘要 · Abstract (English)
Language models increasingly appear to learn similar representations, despite differences in training objectives, architectures, and data modalities. This emerging compatibility between independently trained models introduces new opportunities for cross-model alignment to downstream objectives. Moreover, this capability unlocks new potential application domains, such as settings where security, privacy, or competitive constraints prohibit direct data or model sharing. In this work, we investigate the extent to which representational convergence enables practical linear alignment between large language models. Specifically, we learn affine transformations between the final hidden states of independent models and empirically evaluate these mappings across text generation, embedding classification, and out-of-distribution detection. We find that performance is largely preserved across model pairs, and show for the first time that linear alignment sometimes enables text generation across independently trained models. We further highlight a potential application of linear alignment for privacy-preserving cross-silo inference. The framework learns an affine transformation over a shared public dataset and uses homomorphic encryption to protect client queries. By encrypting only the linear classification operation, the method achieves sub-second inference latency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。