arXiv:2607.12257cs.AIcs.CL2026-07

小模型在本地运行时,看更多原文才能让引用更可信。

On-Device Deep Research at 4B: Exposure Bounds Faithfulness, Retrieval Bounds Coverage

  • 提升每篇文档的阅读量可显著提高引用准确性
  • 引用准确率从0.45升至0.58,与来源好坏无关
  • 先提高阅读量,再优化检索召回率是高效策略

在24GB内存的个人笔记本上部署一个40亿参数的小模型,研究其在本地运行时的引用可靠性。论文区分了两个常被混淆的指标:引用真实性(是否支持所引观点)和可信覆盖度(是否引用了正确来源)。实验对比了400字符与1500字符的阅读量,以及高质量论文与检索到的论文。结果显示,阅读量直接影响真实性:在检索源上,真实度从0.45升至0.58;在高质量源上,从0.37升至0.58,二者趋于一致,说明真实性受限于阅读量而非来源质量。而覆盖度始终维持在0.22左右,因召回率稳定在0.40,无法通过增加阅读量改善。额外阅读约消耗235个输出词元。实际建议:优先提升每篇文档的阅读量,再优化检索召回率。

原文摘要 · Abstract (English)

On-device research agents search a corpus, read sources, and write a cited brief on a personal laptop. Whether their citations are faithful, and at what cost, is unmeasured for a deployable small model. This study fixes one 4B generator on a 24 GB laptop and asks what makes its citations faithful. It separates two quantities usually reported as one number. Cited claim faithfulness asks whether the cited source supports the claim. Trustworthy coverage asks whether the agent also cites the right sources. The study crosses how much of each source the generator sees, 400 against 1500 characters, with the quality of the sources supplied, gold papers against retrieved papers. Two levers fall out, and they act on different outcomes. Exposure sets faithfulness. More of each source lifts faithfulness from 0.45 to 0.58 on retrieved sources and from 0.37 to 0.58 on gold sources, and the two settings converge, so faithfulness is bound by exposure, not by whether the source is correct. The exposure lift is robust to a second, independent judge; the exact convergence is tight under the primary judge and only approximate under the second. Retrieval sets coverage. Trustworthy coverage stays near 0.22 on retrieved sources at any exposure, because recall is held near 0.40, so exposure cannot fix which sources are cited. The extra exposure costs about 235 output tokens. The practical recipe is to raise per source exposure first, cheaply, and then treat retrieval recall as the only remaining lever.

小模型引用可信本地推理检索优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。