arXiv:2412.09796cs.CLcs.AI2024-12被引 24

用多智能体框架自动生成长达17K词的完整专利,效果超越GPT-4等大模型。

AutoPatent: A Multi-Agent Framework for Automatic Patent Generation

  • 设计多智能体系统,分工协作生成长篇专利。
  • 生成专利平均17K token,优于大模型如GPT-4o。
  • 适合需要高效生成高质量专利的研究者或企业。

随着大语言模型(LLMs)能力不断提升,专利处理成为自然语言处理领域的研究热点。然而,现有工作主要集中在分类任务(如专利分类与审查)或短文本生成(如摘要与问答)。本文提出一项新任务Draft2Patent及对应的D2P基准,要求模型基于初始草稿生成平均17,000词的完整专利。由于专利具有专业性强、术语标准化、篇幅长等特点,对LLM构成重大挑战。我们提出多智能体框架AutoPatent,包含基于LLM的规划者、写作者与审查者,结合PGTree和RRAG机制,生成长篇、复杂且高质量的专利文档。实验表明,该框架显著提升多种LLM生成完整专利的能力。更关键的是,仅使用Qwen2.5-7B模型构建的AutoPatent系统,在客观指标与人工评估中均优于更强大模型,包括GPT-4o、Qwen2.5-72B和LLAMA3.1-70B。代码与数据将在论文接收后公开于https://github.com/QiYao-Wang/AutoPatent。

原文摘要 · Abstract (English)

As the capabilities of Large Language Models (LLMs) continue to advance, the field of patent processing has garnered increased attention within the natural language processing community. However, the majority of research has been concentrated on classification tasks, such as patent categorization and examination, or on short text generation tasks like patent summarization and patent quizzes. In this paper, we introduce a novel and practical task known as Draft2Patent, along with its corresponding D2P benchmark, which challenges LLMs to generate full-length patents averaging 17K tokens based on initial drafts. Patents present a significant challenge to LLMs due to their specialized nature, standardized terminology, and extensive length. We propose a multi-agent framework called AutoPatent which leverages the LLM-based planner agent, writer agents, and examiner agent with PGTree and RRAG to generate lengthy, intricate, and high-quality complete patent documents. The experimental results demonstrate that our AutoPatent framework significantly enhances the ability to generate comprehensive patents across various LLMs. Furthermore, we have discovered that patents generated solely with the AutoPatent framework based on the Qwen2.5-7B model outperform those produced by larger and more powerful LLMs, such as GPT-4o, Qwen2.5-72B, and LLAMA3.1-70B, in both objective metrics and human evaluations. We will make the data and code available upon acceptance at \url{https://github.com/QiYao-Wang/AutoPatent}.

专利生成多智能体大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。