通过可学习门控调节激活,解决检索增强生成中的知识冲突问题。
SHIFT: Gate-Modulated Activation Steering for Knowledge Conflict Mitigation in Retrieval-Augmented Generation

- 用轻量门控模块动态调节内部激活,替代传统神经元修改。
- 仅需不到0.01%参数训练,模型主干保持冻结。
- 在六大数据集上优于主流基线,适合需要稳定推理的场景。
检索增强生成(RAG)通过引入外部知识提升大语言模型的生成能力,但检索内容与模型参数化知识之间的冲突已成为关键挑战。现有方法尝试通过识别和编辑知识相关神经元来增强模型对上下文证据的依赖,但这类神经元级修改可能引发连锁副作用,影响模型整体能力,因被修改神经元常与广泛功能纠缠。本文提出SHIFT框架,将神经元级修改转化为可学习的门控调节,使模型能自适应地调整内部表示以缓解知识冲突。技术上,SHIFT引入轻量门控模块,仅优化少于0.01%的可训练参数,同时冻结主干模型。生成过程中,门控模块动态调节内部表征,实现上下文与参数化知识的合理权衡。在六个数据集上的大量实验验证了其有效性。所有数据集与代码已公开于https://github.com/OpenBMB/SHIFT。
原文摘要 · Abstract (English)
Retrieval-augmented generation (RAG) enhances LLMs by incorporating external knowledge to support response generation. However, conflicts between retrieved context and parametric knowledge have emerged as a critical challenge in RAG systems. To mitigate such conflicts, numerous studies have attempted to identify and edit knowledge-related internal neurons, aiming to improve the ability of LLMs to rely on contextual evidence during generation. However, these neuron-level approaches may introduce unintended cascading effects that compromise the general capabilities of LLMs, as the modified neurons are often entangled with broader model behaviors and functionalities. In this paper, we introduce SHIFT, a novel framework that reformulates neuron-level modification as learnable gate modulation, allowing LLMs to adaptively regulate internal activations for knowledge conflict resolution. Technically, our SHIFT equips LLMs with a lightweight gate module and optimizes fewer than 0.01% trainable parameters while keeping the backbone model frozen. During generation, the gate module adjusts the model's internal representations to adaptively leverage contextual and parametric knowledge. Extensive experiments on six datasets validate the effectiveness of our SHIFT in comparison with various competing baselines. All datasets and code are available at https://github.com/OpenBMB/SHIFT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。