首个完整模拟专利审查全流程的基准，支持官方与检索两种评估方式。
PatRe: A Full-Stage Office Action and Rebuttal Generation Benchmark for Patent Examination
- 构建全阶段专利审查流程，包含审查意见与答辩生成
- 涵盖480个真实案例，支持多种LLM性能测试
- 揭示大模型在法律推理与技术判断中的能力差异
专利审查是一项复杂且多阶段的过程，需要技术和法律双重判断，当前面临申请量激增的挑战。现有基准大多将审查视为静态分类或提取任务，未能体现其交互性与迭代性，类似学术论文的审稿与回应过程。本文提出PatRe，首个建模完整专利审查生命周期的基准，包含审查意见生成与申请人答辩环节。PatRe包含480个真实案例，支持基于知识库的检索模拟与理想化评估两种设置。该基准将专利审查重新定义为动态、多轮的论证与回应过程。在多种大模型上的实验揭示了模型性能的关键洞见，包括专有与开源模型的差异，以及审查员分析与申请人答辩任务间的不对称性。这些发现凸显了大模型在建模复杂现实法律推理与技术新颖性判断方面的潜力与局限。代码与数据集已公开，以促进未来研究。
原文摘要 · Abstract (English)
Patent examination is a complex, multi-stage process requiring both technical expertise and legal reasoning, increasingly challenged by rising application volumes. Prior benchmarks predominantly view patent examination as discriminative classification or static extraction, failing to capture its inherently interactive and iterative nature, similar to the peer review and rebuttal process in academic publishing. In this paper, we introduce PatRe, the first benchmark that models the full patent examination lifecycle, including Office Action generation and applicant rebuttal. PatRe comprises 480 real-world cases and supports both oracle and retrieval-simulated evaluation settings. Our benchmark reframes patent examination as a dynamic, multi-turn process of justification and response. Extensive experiments across various LLMs reveal critical insights into model performance, including differences between proprietary and open-source models, as well as task asymmetries between examiner analysis and applicant-side rebuttal. These findings highlight both the potential and current limitations of LLMs in modeling complex, real-world legal reasoning and technical novelty judgment in patent examination. We release our code and dataset to facilitate future research on patent examination modeling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。