arXiv:2604.22897cs.IRcs.AI2026-04被引 1

新基准+小模型突破专利检索瓶颈,效果超大模型。

Citation-Driven Multi-View Training for Patent Embeddings: QaECTER and Sophia-Bench

论文配图:Citation-Driven Multi-View Training for Patent Embeddings: QaECTER and Sophia-Bench
图 1 · 摘自论文原文
  • 用引用关系构建多视角训练数据,提升专利嵌入质量
  • 344M模型在12类查询中全胜,最高比第二名高7.2%
  • 适合专利检索、知识产权分析等实际应用

专利检索支撑创新决策、审查与知识产权策略,但缺乏反映真实搜索场景多样性的评估基准。本文提出Sophia-Bench,一个包含10,000个查询和75,000篇文档的大规模专利检索基准,覆盖十年时间、八类IPC技术领域及十二个司法管辖区。该基准采用12种不同类型的查询(从结构化字段到AI生成摘要),并以引用为基础的真实答案结合新颖的领域相关性度量(InScope)进行评估,可系统衡量模型在各类查询、技术领域与司法管辖区的表现。其次,提出QaECTER模型,一个344M参数的嵌入模型,基于专利引用图和多视图自对齐训练。尽管体积小,其在英文检索嵌入基准(RTEB)上超越了23倍大的第一名模型,并在Sophia-Bench上所有查询类型、IPC类别和司法管辖区内均优于现有专利专用模型,平均NDCG@10最高提升7.2%。该结果在独立外部基准上得到验证,且无需任务特定提示即可超越所有先前模型。两者均面向大规模专利搜索系统的实际部署。

原文摘要 · Abstract (English)

Patent retrieval underpins critical decisions in innovation, examination, and IP strategy, yet progress has been hampered by the absence of benchmarks that reflect the diversity of real world search scenarios. We address this gap with two contributions. First, we introduce Sophiabench, a large-scale patent retrieval benchmark comprising 10,000 queries and 75,000 corpus documents stratified across ten years, eight IPC technology sections, and twelve filing jurisdictions. Unlike prior benchmarks, Sophia-bench tests retrieval using 12 different query types-from structured patent fields to AI-generated summaries-and evaluates results against citation-based ground truth enhanced with a novel domain-relevance metric (InScope). Together, these enable systematic measurement of how well models perform across query types, technology domains, and jurisdictions. Second, we introduce QaECTER, a 344M-parameter embedding model trained on patent citation graphs and multi-view self-alignment. Despite its compact size, QaECTER establishes a new state of the art for patent retrieval. It outperforms the \#1 model on the English retrieval text embedding benchmark (RTEB), a model 23x larger, as well as all existing patent specific models across every query type, IPC section, and jurisdiction on Sophia-bench, with gains of up to 7.2% average NDCG@10 over the next-best model. These results are confirmed on an independent external benchmark, where QaECTER surpasses all prior models without requiring task-specific instruction prompts. Both the benchmark and the model are designed for practical deployment in large-scale patent search systems.

专利检索嵌入模型多视图训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。