用合成多角度问题提升专利问答系统的检索准确率。
Retrieval-Augmented Generation Systems for Intellectual Property via Synthetic Multi-Angle Fine-tuning
- 用大模型生成多样用户提问,训练检索模型理解不同表达的语义
- 在两个专利数据集上检索准确率提升超185%,生成质量提升超53%
- 适合中小机构快速部署,已落地中国最大科研社交平台
知识产权领域的检索增强生成系统常因用户提问形式多样(如口语化、拼写错误、术语模糊)导致检索不准、回答不佳。为此,我们提出多角度问题生成与检索微调方法(MQG-RFM),利用大语言模型模拟多样化用户提问,并微调检索模型以对齐语言差异但语义相同的查询。该方法采用轻量级数据驱动范式,结合提示工程生成与硬负样本挖掘,在无需复杂架构修改的前提下提升检索鲁棒性。在台湾专利问答数据集上的实验表明,该方法在专利咨询数据集上检索准确率提升185.62%,在新型专利技术报告数据集上提升262.26%;生成质量分别优于基线14.22%和53.58%。通过语义感知的检索优化,该方法为中小型机构提供可快速、低成本部署的可靠专利情报解决方案。目前该方法已被中国最大专业科研社交平台ScholarMate采纳,用于实际研发与部署。演示版本可在https://github.com/renruntao/patent_rag获取。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG) systems in the Intellectual Property (IP) field often struggle with diverse user queries, including colloquial expressions, spelling errors, and ambiguous terminology, leading to inaccurate retrieval and suboptimal responses. To address this challenge, we propose Multi-Angle Question Generation and Retrieval Fine-Tuning Method (MQG-RFM), a novel framework that leverages large language models (LLMs) to simulate varied user inquiries and fine-tunes retrieval models to align semantically equivalent but linguistically diverse questions. Unlike complex architectural modifications, MQG-RFM adopts a lightweight Data-to-Tune paradigm, combining prompt-engineered query generation with hard negative mining to enhance retrieval robustness without costly infrastructure changes. Experimental results on a Taiwan patent Q&A dataset show 185.62% improvement in retrieval accuracy on the Patent Consultation dataset and 262.26% improvement on the Novel Patent Technology Report dataset, with 14.22% and 53.58% improvements in generation quality over the baselines, respectively. By bridging the gap between user intent and system comprehension through semantic-aware retrieval optimization, MQG-RFM offers a practical, scalable approach for rapid, cost-effective deployment among small and medium-sized agencies seeking reliable patent intelligence solutions. Additionally, our proposed method has already been adopted by ScholarMate, the largest professional research social networking platform in China, to support real-world development and deployment. A demo version of the instantiated is available at https://github.com/renruntao/patent_rag.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。