arXiv:2504.13054cs.CLcs.AI2025-04被引 2

通过自检索关键段落,让摘要更聚焦、省 tokens。

Aspect-Based Summarization with Self-Aspect Retrieval Enhanced Generation

  • 用嵌入检索自动找与主题相关的文本段落
  • 在多个数据集上表现优于现有方法,且节省生成资源
  • 适合需要精准摘要、避免冗余的场景

面向特定方面生成摘要旨在生成针对性强的总结,克服传统摘要方法资源消耗大和泛化能力差的问题。近年来,大型语言模型在无需训练的情况下展现出潜力,但过度依赖提示工程,存在令牌限制和幻觉问题,尤其在上下文学习中。为此,本文提出一种新框架:自方面检索增强的摘要生成。给定一个方面时,不依赖纯上下文学习,而是采用嵌入驱动的检索机制,识别相关文本片段,提取关键内容,避免无关信息,有效缓解令牌限制。同时,通过删除无关部分优化令牌使用,确保模型严格依据给定方面生成输出。在多个基准数据集上的实验表明,该框架不仅性能更优,还显著缓解了令牌限制问题。

原文摘要 · Abstract (English)

Aspect-based summarization aims to generate summaries tailored to specific aspects, addressing the resource constraints and limited generalizability of traditional summarization approaches. Recently, large language models have shown promise in this task without the need for training. However, they rely excessively on prompt engineering and face token limits and hallucination challenges, especially with in-context learning. To address these challenges, in this paper, we propose a novel framework for aspect-based summarization: Self-Aspect Retrieval Enhanced Summary Generation. Rather than relying solely on in-context learning, given an aspect, we employ an embedding-driven retrieval mechanism to identify its relevant text segments. This approach extracts the pertinent content while avoiding unnecessary details, thereby mitigating the challenge of token limits. Moreover, our framework optimizes token usage by deleting unrelated parts of the text and ensuring that the model generates output strictly based on the given aspect. With extensive experiments on benchmark datasets, we demonstrate that our framework not only achieves superior performance but also effectively mitigates the token limitation problem.

摘要生成检索增强大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。