arXiv:2604.13694cs.AI2026-04被引 1

通过权重替换定位大模型中实现特定能力的真正源头模块。

Weight Patching: Toward Source-Level Mechanistic Localization in LLMs

论文配图:Weight Patching: Toward Source-Level Mechanistic Localization in LLMs
图 1 · 摘自论文原文
  • 用目标模型的权重替换基础模型对应模块,定位关键功能来源。
  • 发现从浅层候选模块到下游执行电路的能力传递层级结构。
  • 适合研究模型内部机制或进行专家模型融合的开发者使用。

机制可解释性旨在将模型行为归因于其内部组件的因果作用。现有工作推进了激活空间定位与因果追踪,但激活空间中重要的模块可能仅是上游信号的聚合或放大,并未在自身参数中编码目标能力。为填补这一空白,本文提出权重替换(Weight Patching),一种针对具有相同架构但表现差异明显的配对模型的参数空间干预方法。给定一个基础模型和一个行为特化模型,在固定输入下,将特化模型中选定模块的权重替换至基础模型。我们在指令遵循任务上实现了该方法,并构建了一个以向量锚点行为接口为核心的框架,提供开放生成中任务相关控制状态是否形成或恢复的共享内部标准。分析揭示了从浅层候选源模块、聚合与路由模块,到下游执行电路的能力层级。恢复组件得分还可指导机制感知的模型合并,提升评估中专家组合的选择性融合效果,并提供额外外部验证。

原文摘要 · Abstract (English)

Mechanistic interpretability seeks to localize model behavior to the internal components that causally realize it. Prior work has advanced activation-space localization and causal tracing, but modules that appear important in activation space may merely aggregate or amplify upstream signals rather than encode the target capability in their own parameters. To address this gap, we propose Weight Patching, a parameter-space intervention method for source-oriented analysis in paired same-architecture models that differ in how strongly they express a target capability under the inputs of interest. Given a base model and a behavior-specialized counterpart, Weight Patching replaces selected module weights from the specialized model into the base model under a fixed input. We instantiate the method on instruction following and introduce a framework centered on a vector-anchor behavioral interface that provides a shared internal criterion for whether a task-relevant control state has been formed or recovered in open-ended generation. Under this framework, the analysis reveals a hierarchy from shallow candidate source-side carriers to aggregation and routing modules, and further to downstream execution circuits. The recovered component scores can also guide mechanism-aware model merging, improving selective fusion across the evaluated expert combinations and providing additional external validation.

机制可解释性权重替换大模型分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。