用记忆图增强大模型专利匹配能力,提升语义理解与推理。
Enhancing the Patent Matching Capability of Large Language Models via the Memory Graph
- 通过记忆图引导大模型遍历专利实体与分类体系
- 在PatentMatch数据集上比基线模型提升17.68%准确率
- 适用于多种大模型,提升跨领域专利推理能力
知识产权管理涉及战略性保护和利用智力资产以提升组织创新力、竞争力与价值创造。专利匹配是其中关键任务,有助于专利的组织与利用。现有方法多依赖大语言模型的涌现能力,直接进行关键词匹配,但忽视专利的层级分类与类别关系。本文提出MemGraph,通过引入基于参数化记忆的内存图来增强大模型的专利匹配能力。具体地,该方法引导大模型遍历其记忆,识别专利中的相关实体,并将其归类到对应本体中。经记忆图遍历后,利用提取的实体与本体信息提升大模型对专利语义的理解能力。在PatentMatch数据集上的实验表明,MemGraph相较基线大模型性能提升17.68%。进一步分析显示,MemGraph在不同大模型上均具备良好泛化性,无论在域内还是域外场景,都能有效增强大模型内部推理过程。所有数据与代码已公开于https://github.com/NEUIR/MemGraph。
原文摘要 · Abstract (English)
Intellectual Property (IP) management involves strategically protecting and utilizing intellectual assets to enhance organizational innovation, competitiveness, and value creation. Patent matching is a crucial task in intellectual property management, which facilitates the organization and utilization of patents. Existing models often rely on the emergent capabilities of Large Language Models (LLMs) and leverage them to identify related patents directly. However, these methods usually depend on matching keywords and overlook the hierarchical classification and categorical relationships of patents. In this paper, we propose MemGraph, a method that augments the patent matching capabilities of LLMs by incorporating a memory graph derived from their parametric memory. Specifically, MemGraph prompts LLMs to traverse their memory to identify relevant entities within patents, followed by attributing these entities to corresponding ontologies. After traversing the memory graph, we utilize extracted entities and ontologies to improve the capability of LLM in comprehending the semantics of patents. Experimental results on the PatentMatch dataset demonstrate the effectiveness of MemGraph, achieving a 17.68% performance improvement over baseline LLMs. The further analysis highlights the generalization ability of MemGraph across various LLMs, both in-domain and out-of-domain, and its capacity to enhance the internal reasoning processes of LLMs during patent matching. All data and codes are available at https://github.com/NEUIR/MemGraph.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。