让智能体一边建知识库一边用,通过反馈提升问答准确率。
WikiLoop: Jointly Learning to Build and Navigate Agent-Native Wikis with Downstream Feedback

- 共享策略同时训练构建和导航,利用下游任务反馈优化知识库
- 在AuthTrace上达到62.6的答对率,比基线高6.3点,多文档查询提升显著
- 无需额外训练即可在多个数据集上超越同架构基线,适合需要持续学习的场景
知识库构建与查询通常孤立优化:检索增强型智能体依赖外部维护的固定索引,而构建过程缺乏下游使用信号。本文提出WikiLoop,一种耦合反馈的联合框架,用于构建和导航由机器主导的持久化链接式知识库。一个角色条件化的共享策略支持两种接口:导航器从知识库中检索证据回答问题,构建者提出结构化编辑并由下游导航效果评估。导航器遵循‘充分性优先于效率’目标,在完全收集证据后才施加检索成本惩罚。构建者通过效用差异学习:冻结的导航器评估每个候选编辑对下游性能的影响,同时设置保护惩罚以避免无关查询的退化。训练结合角色特异性的序列优化与最终的角色同质批量联合阶段。以Qwen3.5-9B为通用主干,WikiLoop在AuthTrace上取得62.6的综合答对率,比LLM-Wiki base高出6.3点,尤其在多文档查询上提升最大。受控对比验证了两个目标的有效性,且学习到的编辑仍对保留的导航器有用。成对比较表明,最终共享策略基本保留了各自角色能力,相比专用模型提升导航与端到端答对率0.4点,并将双接口整合为单一模型。在无数据集特定训练的情况下,也优于同主干的LLM-Wiki base,在HotpotQA与MuSiQue上表现更佳。
原文摘要 · Abstract (English)
Knowledge-base construction and querying are typically optimized in isolation: retrieval-augmented agents operate over a fixed, externally maintained index, whereas construction receives no signal from downstream use. We present WikiLoop, a feedback-coupled framework that jointly learns to build and navigate an agent-native Wiki, a persistent linked-page knowledge base designed for machine navigation. A role-conditioned shared policy supports two interfaces: a Navigator retrieves evidence from the Wiki to answer queries, and a Builder proposes structured edits evaluated through downstream navigation. The Navigator follows a sufficiency-before-efficiency objective that applies retrieval-cost penalties only after full evidence has been collected. The Builder learns from utility differences: a frozen Navigator scores each candidate edit by its change in downstream performance, while a guard penalty discourages regressions on unrelated queries. Training combines sequential role-specific optimization with a final joint stage over role-homogeneous batches. With Qwen3.5-9B as the common backbone, WikiLoop reaches 62.6 aggregate Answer Correctness on AuthTrace, 6.3 points above LLM-Wiki, base, with the largest gains on multi-document queries. Controlled comparisons support the intended effects of both objectives, and the learned edits remain useful to a held-out Navigator. Paired comparisons indicate that the final shared policy largely retains both role-specific capabilities, improves Navigator and end-to-end Answer Correctness by 0.4 points relative to the corresponding specialist references, and consolidates both interfaces into one model. Without dataset-specific training, WikiLoop also improves over the same-backbone LLM-Wiki, base on HotpotQA and MuSiQue.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。