arXiv:2607.03065cs.LGcs.AI2026-07

通过提取模型参数的谱核心,实现推理能力增强与多领域融合。

Spectral Rewiring for Exploration, Purification, and Model Merging

论文配图:Spectral Rewiring for Exploration, Purification, and Model Merging
图 1 · 摘自论文原文
  • 从参数几何中识别并保留推理有效的谱成分,剔除干扰项。
  • 仅用0.58%参数即保持99%性能,数学推理探索能力显著提升。
  • 适用于模型精炼与跨领域合并,适合需要高效多任务模型的场景。

强化学习已成为大语言模型后训练的标准方法,但全参数密集更新带来两大部署瓶颈:推理性能下降,常表现为测试时缩放提前饱和;在多领域训练或模型合并时产生干扰。我们发现这些更新中有效推理成分主要集中在基础模型的谱空间,据此提出事后编辑方法子空间对齐重连(SAR),保留该谱核心并移除正交分量。SAR因此既保留推理增益,又过滤抑制性能或放大跨域干扰的残余方向。在多个模型家族与规模下,SAR仅用约0.58%总参数即可提取紧凑推理核心:保留超过99%后训练性能,提升高k值下的数学推理探索能力,并在自研模型上使六项七项开源编码基准表现改善。SAR还能净化混合领域训练更新,释放被压制的编码能力,同时维持数学推理与指令遵循。它进一步实现专家间模型合并,获得超越先前合并基线甚至最优单领域专家的跨域泛化能力。总体表明,从参数几何中提取推理有效更新可作为无需训练的机制,提升推理与多领域表现。

原文摘要 · Abstract (English)

Reinforcement learning has become a standard post-training recipe for large language models, but dense full-parameter updates create two deployment-relevant bottlenecks: suppressed reasoning performance, often reflected by premature saturation of test-time scaling, and interference when consolidating multiple capabilities through multi-domain training or model merging. We show that the reasoning-effective component of these updates is largely concentrated in the base model's spectral space, motivating Subspace-Aligned Rewiring (SAR), a post-hoc editing method that retains this spectral core while removing orthogonal components. SAR therefore preserves reasoning gains and filters residual update directions that suppress performance or amplify cross-domain interference. Across several model families and scales, SAR extracts compact reasoning cores using as little as approximately 0.58% of total parameters: it preserves over 99% of post-training performance and improves high-k exploration in mathematical reasoning, and generalizes to agentic coding by improving six of seven open benchmarks on an in-house model. SAR also purifies mixed-domain training updates by releasing suppressed coding capability while maintaining math reasoning and instruction following. It further enables model merging across experts, yielding cross-domain generalization that surpasses previous merging baselines and even the best single-domain experts. Overall, SAR shows that extracting reasoning-effective updates from parameter geometry can serve as a training-free mechanism to improve reasoning and multi-domain performance.

模型精炼推理增强模型合并

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。