发现大模型错在用不上已知知识,而非没知识。
Missing vs. Unused Knowledge Hypothesis for Language Model Bottlenecks in Patent Understanding
- 用提问法区分错误是缺知识还是不会用。
- 多数错误源于知识未被调用,而非知识缺失。
- 小模型提问更简单易用,大模型提问更复杂但效率低。
尽管大型语言模型(LLMs)在事实回忆上表现优异,但真正挑战在于知识的应用。在需要深层概念理解才能区分语义相似但实质不同的专利的专利分类任务中,模型常难以做出准确判断。我们通过一种新框架将模型错误分解为‘缺失知识’和‘未使用知识’两类。该方法通过引导模型生成澄清性问题,并比较三种情形:原始性能、自我回答问题以激活内部知识、外部提供答案补充缺失知识。结果显示,大多数错误源于未能调用已有知识,而非真正缺乏知识。此外,我们发现不同规模模型构建任务特定问答库的方式不同:小模型生成更简单的可检索问题,其他模型也能有效利用;而大模型生成更复杂的问题,实际效果反而较差,表明模型规模间存在互补优势。这些发现表明,从静态事实回忆转向动态知识应用评估,能更真实反映模型能力。
原文摘要 · Abstract (English)
While large language models (LLMs) excel at factual recall, the real challenge lies in knowledge application. A gap persists between their ability to answer complex questions and their effectiveness in performing tasks that require that knowledge. We investigate this gap using a patent classification problem that requires deep conceptual understanding to distinguish semantically similar but objectively different patents written in dense, strategic technical language. We find that LLMs often struggle with this distinction. To diagnose the source of these failures, we introduce a framework that decomposes model errors into two categories: missing knowledge and unused knowledge. Our method prompts models to generate clarifying questions and compares three settings -- raw performance, self-answered questions that activate internal knowledge, and externally provided answers that supply missing knowledge (if any). We show that most errors stem from failures to deploy existing knowledge rather than from true knowledge gaps. We also examine how models differ in constructing task-specific question-answer databases. Smaller models tend to generate simpler questions that they, and other models, can retrieve and use effectively, whereas larger models produce more complex questions that are less effective, suggesting complementary strengths across model scales. Together, our findings highlight that shifting evaluation from static fact recall to dynamic knowledge application offers a more informative view of model capabilities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。