专利审查中,人类写作因低困惑度被误判为AI生成,检测工具普遍失效。
The Perplexity Trap: When Patent Law Makes Human Writing Look Like AI

- 用开源零样本检测器在消费级显卡上测试,发现人类专利文本常被误判为AI生成。
- 在权利要求级别,所有检测工具误报率超60%,最高达80.5%。
- 改进的语义复杂度模型在相同硬件下准确率提升13个百分点,适合实际审查场景。
欧洲专利局(EPO)2025年专利申请创纪录,2026年指南要求申请人对大语言模型辅助内容负责。但现实审查环境受限于仅8GB显存的消费级显卡,且专利权利要求需清晰简洁,导致人类写作与大模型输出落在相似的低困惑度、低突发性分布中。我们在500个已授权电信类专利与500个大模型生成文本之间,基于五种提示策略,使用三种开源零样本检测器进行基准测试。结果表明,在权利要求层级,所有检测器误报率均超过60%:Binoculars达78.3%,Fast-DetectGPT为61.3%,DetectGPT高达80.5%。该问题在不同模型重生成、跨技术领域复制及高端硬件复测下依然存在,说明其为结构性难题而非模型容量问题。采用七特征语言复杂度逻辑回归模型,准确率达74.0%,误报率降至28.1%,较仅依赖困惑度的基线提升13个百分点,且无需推理时概率值,符合硬件限制。
原文摘要 · Abstract (English)
The European Patent Office (EPO) reported record filings in 2025, and the 2026 EPO Guidelines hold applicants strictly responsible for LLM-assisted content under Article 83 and Rule 42, creating pressure to triage suspected AI-generated patent text. Two constraints make this hard. First, realistic prosecution settings often have only consumer GPUs with about 8 GB VRAM, not datacenter-class scoring stacks. Second, Article 84 of the European Patent Convention requires claims to be clear and concise, pushing human drafting onto the same low-perplexity, low-burstiness manifold that LLMs occupy. We benchmark three open-source zero-shot detectors on 500 granted EPO H04 telecom patents versus 500 LLM-generated counterparts using five prompting strategies, all under the consumer hardware envelope. At claim level, all detectors exceed 60 percent false-positive rate: Binoculars 78.3 percent, Fast-DetectGPT 61.3 percent, DetectGPT 80.5 percent. The failure persists under Qwen2.5-3B-Instruct regeneration, LoRA-adapted Pythia-2.8B scoring heads, cross-IPC replication on A61K, C07D, and F03D (mean FPR 84.6 percent), and H100 re-evaluation with published Falcon-7B and GPT-J-6B heads, arguing the issue is structural rather than substitute-model capacity. A seven-feature linguistic-complexity logistic regression reaches 74.0 percent accuracy at 28.1 percent FPR, a 13 percentage-point gain over a perplexity-only baseline at a comparable operating point, without using likelihood at inference and within the same hardware budget.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。