用图注意力模型提升专利检索效率与准确率
Efficient Patent Searching Using Graph Transformers
- 将专利内容建模为特征关系图,用图变压器进行语义匹配
- 相比纯文本模型,检索准确率显著提升,处理速度更快
- 适合专利审查员、企业知识产权部门高效查新
在决定是否申请新专利或无效现有专利时,找到相关现有技术至关重要。然而,由于专利文档数量庞大且需精细判断新颖性,检索工作极具挑战。我们提出一种基于图变压器的密集检索方法,将每个发明表示为描述其特征及相互关系的图结构。模型通过专利审查员引用的现有技术作为相关性信号进行训练,利用图结构输入显著提升了长文档处理的计算效率,同时借助审查员标注使模型学习到超越简单文本匹配的领域特定相似性。结果是一个能模拟专业审查员判断逻辑的检索系统。与公开可用的文本嵌入模型对比,本方法在现有技术检索质量与计算效率上均实现显著提升。
原文摘要 · Abstract (English)
Finding relevant prior art is crucial when deciding whether to file a new patent application or invalidate an existing patent. However, searching for prior art is challenging due to the large number of patent documents and the need for nuanced comparisons to determine novelty. An accurate search engine is therefore invaluable for speeding up the process. We present a Graph Transformer-based dense retrieval method for patent searching where each invention is represented by a graph describing its features and their relationships. Our model processes these invention graphs and is trained using prior art citations from patent office examiners as relevance signals. Using graphs as input significantly improves the computational efficiency of processing long documents, while leveraging examiner citations allows the model to learn domain-specific similarities beyond simple text-based matching. The result is a search engine that emulates how professional patent examiners identify relevant documents. We compare our approach against publicly available text embedding models and show substantial improvements in both prior art retrieval quality and computational efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。