arXiv:2605.28722cs.AI2026-05中稿 · ICML

根据输入动态调整干预强度,提升大模型对齐效果且不损伤通用能力。

Multi-Adapter Representation Interventions via Energy Calibration

论文配图:Multi-Adapter Representation Interventions via Energy Calibration
图 1 · 摘自论文原文
  • 用多专家适配器动态选择干预方向和强度
  • 在TruthfulQA等基准上性能领先,同时保持MMLU表现
  • 适合需要精准控制模型行为的场景

表示干预已成为无需修改模型权重即可对齐大语言模型行为的有前景方法。现有方法通常对所有输入采用固定干预,但我们发现不同样本所需的干预方向与强度差异显著,统一干预会导致良性输入上通用能力下降。为此,我们提出基于能量校准的多适配器表示干预(MARI)。具体而言,引入竞争式多适配器机制,由专用专家捕捉非线性修正模式,并自适应确定不同样本的干预方向与强度;同时设计基于能量的门控模块,利用内部传播动态区分适合干预的输入。在多种模型家族与参数规模下的大量实验表明,MARI实现顶尖对齐性能,在TruthfulQA、BBQ和安全基准上显著提升,同时在MMLU和ARC等任务上保持甚至提升通用能力。代码已开源。

原文摘要 · Abstract (English)

Representation intervention has emerged as a promising paradigm for aligning large language models toward desired behaviors without modifying model weights. Existing methods typically apply a fixed intervention uniformly across all inputs. However, we find that the appropriate intervention direction and strength vary substantially across samples, and such indiscriminate intervention leads to degradation of general capabilities on benign inputs. To address these challenges, we propose Multi-Adapter Representation Interventions via Energy Calibration (MARI). Specifically, we introduce a competitive multi-adapter mechanism in which specialized experts capture non-linear correction patterns and adaptively determine the appropriate intervention direction and strength for different samples. Furthermore, we design an energy-based gating module that leverages internal propagation dynamics to distinguish inputs that are applicable for intervention. Extensive experiments across diverse model families and parameter scales demonstrate that MARI achieves state-of-the-art alignment performance. Our method significantly improves performance on TruthfulQA, BBQ, and safety benchmarks, while maintaining and even improving general capabilities on tasks such as MMLU and ARC. Our code is available at https://github.com/V1centNevwake/MARI.

模型对齐表示干预多适配器动态调整

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。