用可复用的LLM Wiki模板记录失败与成功,让团队协作知识永久留存。
Beyond Memory: A Templated Substrate for Heterogeneous Collaborative Knowledge Work with LLM Agents
- 构建带版本追踪的LLM维护维基,支持跨会话持续记忆
- 三案例验证:修复错误、保留失败路径、跨领域教育应用
- 特别适合需要透明溯源的研究/开发团队,解决知识断层问题
研究项目、教育工作等知识活动积累的成果、决策和推理,常被后续合作者忽视。最有价值的部分,包括失败尝试和撤回主张,通常未被发表或共享代码包含;未来研究者重复同样的失败,因无记录留存。当前主流的LLM编码代理缺乏会话间持久记忆,而对原始资料的检索增强生成也无法累积知识。我们提出llm-wiki-memory-template,一种可复用、代理感知的模板实例,作为异构协作知识工作的基础架构。该架构通过三个独立组件支持多人类、多智能体、多领域协作(§4)。维基采用追加只读模式,既保留成功也保存失败路径,解决出版与代码共享结构无法涵盖的负结果丢失问题。三个已部署案例与一份设计报告分别验证了各轴:单人研究线中保存被放弃的迭代;双人项目经事后审计将原声称的20/20覆盖率修正为14和12,修复后回升至18和18,全程保留失败路径;正在进行的多智能体部署以设计报告形式呈现;以及跨领域的教育变体。我们定义失败路径保留、代理诚实性、可采纳性为该成果的共通社会技术属性,不仅限于技术机制。
原文摘要 · Abstract (English)
Research projects, educational efforts, and adjacent knowledge work accumulate findings, decisions, and reasoning that future collaborators rarely recover. The parts most useful to that work, including dead ends and walked-back claims, are routinely excluded from publications and shared code; future researchers re-attempt the same failures because no record survives. LLM coding agents are common participants but hold no persistent memory across sessions, and retrieval-augmented generation over raw sources does not compound. The llm-wiki pattern (Karpathy, 2026; tonbi, 2026) addresses this by inserting an LLM-maintained, interlinked wiki between raw sources and the agent. We present llm-wiki-memory-template, a reusable, agent-aware instantiation, and argue it is a substrate for heterogeneous collaborative knowledge work along three axes (multi-human, multi-AI-agent, multi-domain) with each axis supported by a distinct architectural element of the template (§4). The wiki is append-only by convention, which preserves what did not work alongside what did, addressing a negative-result loss problem that publications and code-sharing structurally cannot solve. Three deployed case studies and one design report cover the axes individually: a solo research lineage that preserves abandoned iterations; a two-author project whose retroactive audit revised two prior experiments' claimed 20-of-20 coverage down to 14 and 12 evidence-based answers, then to 18 and 18 after a fix, with the failure path preserved across the artifact; an in-progress multi-agent deployment reported as a design; and a cross-domain educational variant. We name failure-path preservation, agent honesty, and appropriation as cross-cutting sociotechnical properties of the artifact, not only of its technical mechanisms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。