arXiv:2505.14179cs.CLcs.AI2025-05被引 17

利用结构信息提升科学论文摘要生成质量

Enhancing Abstractive Summarization of Scientific Papers Using Structure Information

  • 分两阶段:先自动识别章节功能,再用Longformer生成上下文相关摘要
  • 在两个领域数据集上优于现有方法,摘要更全面
  • 适合需要精准摘要的科研人员和文献综述者

科学论文的抽象摘要生成一直是研究热点,但现有方法面临两大挑战:一是多数模型采用编码器-解码器架构,将论文视为词序列,难以充分捕捉其结构信息;二是现有研究常依赖关键词映射或特征工程识别结构,却难以应对科学论文的结构灵活性,且跨学科鲁棒性差。为此,我们提出一种两阶段的抽象摘要框架,通过自动识别科学论文中的结构功能来解决上述问题。第一阶段,标准化大量科学论文的章节标题,构建大规模结构功能识别数据集,并训练分类器自动识别关键结构组件(如背景、方法、结果、讨论),为生成平衡摘要奠定基础。第二阶段,采用Longformer模型捕捉跨章节的丰富上下文关系,生成上下文感知的摘要。在两个领域特定科学论文摘要数据集上的实验表明,该方法优于先进基线,生成的摘要更加全面。代码与数据集可在https://github.com/tongbao96/code-for-SFR-AS获取。

原文摘要 · Abstract (English)

Abstractive summarization of scientific papers has always been a research focus, yet existing methods face two main challenges. First, most summarization models rely on Encoder-Decoder architectures that treat papers as sequences of words, thus fail to fully capture the structured information inherent in scientific papers. Second, existing research often use keyword mapping or feature engineering to identify the structural information, but these methods struggle with the structural flexibility of scientific papers and lack robustness across different disciplines. To address these challenges, we propose a two-stage abstractive summarization framework that leverages automatic recognition of structural functions within scientific papers. In the first stage, we standardize chapter titles from numerous scientific papers and construct a large-scale dataset for structural function recognition. A classifier is then trained to automatically identify the key structural components (e.g., Background, Methods, Results, Discussion), which provides a foundation for generating more balanced summaries. In the second stage, we employ Longformer to capture rich contextual relationships across sections and generating context-aware summaries. Experiments conducted on two domain-specific scientific paper summarization datasets demonstrate that our method outperforms advanced baselines, and generates more comprehensive summaries. The code and dataset can be accessed at https://github.com/tongbao96/code-for-SFR-AS.

摘要生成结构信息科学论文Longformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。