arXiv:2509.03934cs.CLcs.AI2025-09EMNLP被引 16

通过自对齐输入分布,缓解检索增强生成中的灾难性遗忘。

SelfAug: Mitigating Catastrophic Forgetting in Retrieval-Augmented Generation via Distribution Self-Alignment

  • 用输入序列逻辑值自对齐,保持模型语义分布不变
  • 在下游任务上提升性能同时保留原始通用能力
  • 适合需要持续学习的RAG场景和模型微调研究者

大型语言模型(LLMs)在自然语言处理中取得显著进展,其在多样化任务上的理解与执行能力令人瞩目。尽管监督微调,特别是检索增强生成(RAG)场景下的微调,能有效提升特定任务性能,但常导致灾难性遗忘,即模型丧失先前习得的知识与通用能力。现有方法要么需访问通用指令数据,要么难以保持模型原始分布。为此,我们提出SelfAug,一种自分布对齐方法,通过将输入序列的逻辑值对齐以维持模型的语义分布,从而缓解灾难性遗忘并提升下游表现。大量实验证明,SelfAug在下游学习与通用能力保留之间实现了更优平衡。全面的实证分析揭示了分布偏移与灾难性遗忘严重程度之间的直接关联,凸显了通用指令微调中缺乏RAG能力会导致微调过程中显著分布偏移。这些发现不仅深化了对RAG环境下灾难性遗忘的理解,也为多种微调场景提供了实用解决方案。代码已公开于https://github.com/USTC-StarTeam/SelfAug。

原文摘要 · Abstract (English)

Recent advancements in large language models (LLMs) have revolutionized natural language processing through their remarkable capabilities in understanding and executing diverse tasks. While supervised fine-tuning, particularly in Retrieval-Augmented Generation (RAG) scenarios, effectively enhances task-specific performance, it often leads to catastrophic forgetting, where models lose their previously acquired knowledge and general capabilities. Existing solutions either require access to general instruction data or face limitations in preserving the model's original distribution. To overcome these limitations, we propose SelfAug, a self-distribution alignment method that aligns input sequence logits to preserve the model's semantic distribution, thereby mitigating catastrophic forgetting and improving downstream performance. Extensive experiments demonstrate that SelfAug achieves a superior balance between downstream learning and general capability retention. Our comprehensive empirical analysis reveals a direct correlation between distribution shifts and the severity of catastrophic forgetting in RAG scenarios, highlighting how the absence of RAG capabilities in general instruction tuning leads to significant distribution shifts during fine-tuning. Our findings not only advance the understanding of catastrophic forgetting in RAG contexts but also provide a practical solution applicable across diverse fine-tuning scenarios. Our code is publicly available at https://github.com/USTC-StarTeam/SelfAug.

大模型微调RAG灾难性遗忘

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。