不建结构也能高效查聊天记录,靠可控搜索击败复杂记忆系统。
When Your Agent Opens the Chat App: Agent-Controlled Search over Raw Chat Logs Rivals Structured Memory

- 用关键词迭代搜索原始聊天日志,不做任何语义结构化处理。
- 在MemoryAgentBench上达到58.2的平均准确率,超越图/树结构系统。
- 适合需要精准证据支持的对话记忆任务,如多跳问答与事件排序。
当前代理-记忆系统常通过结构化处理(如摘要、嵌入、知识图谱)提升检索质量,但其优势是否源于结构本身尚不明确。本文提出ReFind,一种无需构建语义结构的代理控制搜索接口:保留聊天记录原样,按对话轮次进行词汇索引,结合四种基于实证研究的聊天原生控制机制——会话感知排序融合、局部上下文扩展、时间范围缩小、跳过已检会话,并通过独立推理阶段从收集证据中作答。在MemoryAgentBench的增量多轮设置下,对约2800个精确检索与事实追踪问题评估,ReFind在单跳与多跳问答、事件排序、事实整合等任务中取得最高均值准确率58.2,高于最强图/树结构系统HippoRAG 2(53.2),所有实验均使用相同GPT-4o-mini模型。对照实验进一步验证了代理控制、聊天原生控件及词法检索的有效性。在LongMemEval-S/M上,同接口使用GPT-5-mini达93.2±3.3和89.3±6.0。结果表明,对于基于聊天档案的精确、证据驱动问题,大量原本归功于复杂结构的收益,可通过代理可控搜索原始记录实现,无需任何大模型索引构建。
原文摘要 · Abstract (English)
Agent-memory systems increasingly buy retrieval quality with structure, transforming raw conversation histories into summaries, embeddings, trees, or knowledge graphs before any question is asked. We ask how much of that benefit comes from the structure itself, rather than from competent retrieval over the raw history. We present ReFind, an agent-controlled search interface that builds no semantic structure at all: it leaves the conversation archive unmodified, indexes it lexically at turn granularity, and combines a generic iterative keyword-search loop with four chat-native controls grounded in empirical refinding work: session-aware rank fusion, local context expansion, temporal narrowing, and skipping already-inspected sessions. A separate reasoning stage answers from the collected evidence. Across a broad suite of conversational-memory tasks (single- and multi-hop QA, event ordering, and fact consolidation), roughly 2,800 questions on precise-retrieval and fact-tracking capabilities evaluated under the incremental multi-turn setting of MemoryAgentBench, ReFind attains the highest mean accuracy (58.2) of any system compared, above the strongest graph- and tree-based memory systems (HippoRAG 2, 53.2), all under a GPT-4o-mini backbone matched to every reused baseline. Controlled comparisons to single-shot BM25, a matched generic-agentic BM25 control, component removals, and agentic dense/hybrid variants separately support the roles of agent control, chat-native controls, and lexical retrieval. On LongMemEval-S/M, the same interface reaches 93.2 +/- 3.3 and 89.3 +/- 6.0 with GPT-5-mini. The results indicate that for precise, evidence-grounded questions over chat archives, much of the benefit credited to elaborate memory structures is recoverable by giving an agent controllable search over the unmodified record, with no LLM-based index construction at all.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。