arXiv:2409.00092cs.CLcs.AI2024-09中稿 · publication in Adv…被引 31

用专精知识微调大模型,自动生成专利创意。

Large Language Model for Patent Concept Generation

  • 通过知识注入预训练+领域微调+人类反馈强化,提升模型专利生成能力。
  • 在专利基准测试中显著优于现有模型,生成概念更贴合技术细节。
  • 适合科技研发、知识产权布局的从业者使用,推动AI驱动创新。

在传统创新实践中,概念与知识产权生成常需迭代融合,依赖对前沿技术领域的深刻理解。现有大语言模型虽具备海量预训练知识,但在创新概念生成上因缺乏特定领域知识而表现不足。为填补这一关键差距,我们提出一种新型知识微调(KFT)框架,使基于大模型的AI能自主挖掘、理解并应用领域专有知识与概念,实现发明生成(即概念与专利联合生成)。所提出的PatentGPT整合了知识注入预训练(KPT)、领域特定监督微调(SFT)和基于人类反馈的强化学习(RLHF)。大量评估表明,PatentGPT在专利相关基准测试中显著优于当前最优模型。该方法不仅为数据驱动创新提供新视角,也为大模型在技术场景下的微调提供了新路径。我们还探讨了未来AI生成发明在管理与政策层面的意义。

原文摘要 · Abstract (English)

In traditional innovation practices, concept and IP generation are often iteratively integrated. Both processes demand an intricate understanding of advanced technical domain knowledge. Existing large language models (LLMs), while possessing massive pre-trained knowledge, often fall short in the innovative concept generation due to a lack of specialized knowledge necessary for the generation. To bridge this critical gap, we propose a novel knowledge finetuning (KFT) framework to endow LLM-based AI with the ability to autonomously mine, understand, and apply domain-specific knowledge and concepts for invention generation, i.e., concept and patent generation together. Our proposed PatentGPT integrates knowledge injection pre-training (KPT), domain-specific supervised finetuning (SFT), and reinforcement learning from human feedback (RLHF). Extensive evaluation shows that PatentGPT significantly outperforms the state-of-the-art models on patent-related benchmark tests. Our method not only provides new insights into data-driven innovation but also paves a new path to fine-tune LLMs for applications in the context of technology. We also discuss the managerial and policy implications of AI-generating inventions in the future.

专利生成大模型知识微调AI创新

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。