arXiv:2606.25253cs.CLcs.DL2026-06

用提示学习自动生成论文亮点,无需标注数据也能达到顶尖水平。

Automatic Generation of Highlights for Academic Paper Via Prompt-based Learning

  • 设计特定提示模板,结合摘要输入语言模型生成亮点。
  • 仅用少量示例提示,性能超越现有最先进方法。
  • 适合缺乏标注数据的学术文本挖掘与文献分析场景。

亮点为学术论文的核心贡献提供简明总结,有助于读者快速把握重点。然而,许多期刊不提供亮点,限制了其在文献检索、文本挖掘和计量分析中的应用。现有研究多采用监督学习方法自动提取亮点,但通常需要大量标注训练数据。本文探索基于提示的学习方法实现自动亮点生成。我们设计任务特定的提示模板,将论文摘要与提示共同作为模型输入。评估了包括本地部署的GPT-2、T5及通过API调用的ChatGPT在内的多个语言模型。在三个数据集上的实验表明,使用提示模板的ChatGPT在无需任务特定训练样本的情况下,性能可媲美以往监督方法;当在提示中加入少量示例时,在两个数据集上显著优于现有最先进方法。进一步分析显示,尽管ChatGPT具备强大语言建模能力,其表现高度依赖提示中提供的信息。案例研究也表明,生成的亮点整体连贯、信息丰富,接近作者撰写水平。本研究是首批将提示学习应用于学术亮点生成的工作之一。所提方法不依赖领域特定训练语料,可为缺乏此类信息的论文生成亮点,从而支持下游文本挖掘与计量研究。

原文摘要 · Abstract (English)

Highlights provide a concise summary of the main contributions of an academic paper and help readers quickly understand its focus. However, many journals do not provide highlights, which limits their use in literature retrieval, text mining, and bibliometric analysis. Existing studies have explored supervised learning methods for automatic highlight extraction, but these methods usually require large amounts of labeled training data. This study investigates prompt-based learning for automatic highlight generation. We design task-specific prompt templates and combine them with paper abstracts as model inputs. Several language models are evaluated, including locally deployed pre-trained models such as GPT-2 and T5, as well as ChatGPT accessed through an API. Experiments on three datasets show that ChatGPT with prompt templates achieves performance comparable to previous supervised methods without using task-specific training samples. When a small number of examples are added to the prompts, the model significantly outperforms state-of-the-art methods on two datasets. We further analyze how prompt design affects generation quality and find that, although ChatGPT has strong language modeling ability, its performance on this task is highly sensitive to the information provided in the prompt. Case studies also show that the generated highlights are generally coherent, informative, and close to author-written highlights. This study is among the first to apply prompt-based learning to academic highlight generation. The proposed method does not rely on domain-specific training corpora and can generate highlights for papers that lack such information, thereby supporting downstream text mining and bibliometric research.

提示学习文本生成学术写作零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。