arXiv:2411.14072cs.CLcs.PL2024-11被引 3

用主从编码器融合说明书与权利要求,提升专利摘要生成质量。

The Master-Slave Encoder Model for Improving Patent Text Summarization: A New Approach to Combining Specifications and Claims

  • 主从编码器融合说明书与权利要求,挖掘文本间深层关联
  • 指针网络增强新术语识别,重加权机制提升信息相关性
  • 专利文本重复抑制机制,生成更精准无冗余摘要

为解决传统专利摘要模型仅基于说明书导致生成质量不足、快速更新引发的新术语未登录词(OOV)问题,以及忽略专利文本高专业性、准确性与独特性带来的信息冗余问题,本文提出一种基于主从编码器架构的专利摘要生成模型(MSEA)。该模型首先设计主从编码器,将说明书与权利要求作为输入,充分挖掘两者间的特征与细节;其次,基于指针网络增强对输入序列中新术语的捕捉能力,并通过重加权编码器中“记忆”与“遗忘”部分,进一步提升与原文的相关性;最后引入针对专利文本的增强型重复抑制机制,确保生成摘要准确且无冗余。在公开专利数据集上,相较于当前最优模型IMHAM,MSEA在Rouge-1、Rouge-2和Rouge-L指标上分别提升0.006、0.005和0.005,实验验证了其先进性与有效性。

原文摘要 · Abstract (English)

In order to solve the problem of insufficient generation quality caused by traditional patent text abstract generation models only originating from patent specifications, the problem of new terminology OOV caused by rapid patent updates, and the problem of information redundancy caused by insufficient consideration of the high professionalism, accuracy, and uniqueness of patent texts, we proposes a patent text abstract generation model (MSEA) based on a master-slave encoder architecture; Firstly, the MSEA model designs a master-slave encoder, which combines the instructions in the patent text with the claims as input, and fully explores the characteristics and details between the two through the master-slave encoder; Then, the model enhances the consideration of new technical terms in the input sequence based on the pointer network, and further enhances the correlation with the input text by re weighing the "remembered" and "for-gotten" parts of the input sequence from the encoder; Finally, an enhanced repetition suppression mechanism for patent text was introduced to ensure accurate and non redundant abstracts generated. On a publicly available patent text dataset, compared to the state-of-the-art model, Improved Multi-Head Attention Mechanism (IMHAM), the MSEA model achieves an improvement of 0.006, 0.005, and 0.005 in Rouge-1, Rouge-2, and Rouge-L scores, respectively. MSEA leverages the characteristics of patent texts to effectively enhance the quality of patent text generation, demonstrating its advancement and effectiveness in the experiments.

专利摘要主从编码文本生成指针网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。