让智能体在大语料中高效搜索,通过动态扩展工作区实现快速精准操作。
Dr-DCI: Scaling Direct Corpus Interaction via Dynamic Workspace Expansion

- 用检索器动态拉取相关文档到本地工作区,减少直接操作全量语料的开销。
- 在100K至1000万文档规模下保持稳定性能,最高准确率达73.3%。
- 适合需要跨文档验证和灵活操作的大规模智能搜索任务。
基于检索器的代理搜索依赖于可扩展的候选发现机制(如BM25或ColBERT),但仅提供排序结果或有限文档视图,限制了代理对信息的重组与跨文档校验能力。直接语料交互(DCI)通过暴露可执行的语料操作,支持灵活搜索、过滤、比较和验证。然而,随着语料增长,全语料终端命令变得缓慢且不稳定。本文提出DR-DCI框架,将检索视为可调用的代理动作,用于动态扩展局部工作区。代理不在全量语料上直接操作,而是将相关文档逐步拉入演化中的工作区,并在此执行DCI操作。该设计结合了检索的召回能力与DCI的局部精度:检索保障探索可扩展性,而本地操作确保有效证据解析。实验表明,DR-DCI在不同规模下均具高效性。在Browsecomp-Plus上,准确率达71.2%,相比原始DCI及消融变体提升最高达8.3个百分点,同时降低工具使用、运行时间和估算成本;引入工作区保留的上下文重置后,准确率进一步提升至73.3%。在语料扩展实验中,DR-DCI在10万至1000万文档范围内表现稳定,而原始DCI出现不稳定性,BM25性能显著下降。该方法还成功扩展至2000万级文件-文档的Wiki-18 QA设置,在六个基准上平均得分63.0,超越基于检索和训练的搜索代理基线。消融分析显示,排名预览和跨文档DCI是性能关键。
原文摘要 · Abstract (English)
Agentic search over large corpora relies on retriever-mediated interfaces (e.g., BM25 or ColBERT) for scalable candidate discovery. While effective at ranking relevant documents, these interfaces expose evidence only as ranked results or bounded document views, limiting agents' ability to reorganize material and verify constraints across documents. Direct Corpus Interaction (DCI) addresses this limitation by exposing shell-executable corpus operations for flexible search, filtering, comparison, and verification. However, full-corpus terminal commands become slow and unstable as the corpus grows, degrading performance and efficiency. We introduce DR-DCI, a retriever-steered DCI framework that treats retrieval as an agent-callable action for expanding a local workspace. Rather than operating directly over the full corpus, the agent dynamically pulls relevant documents into an evolving workspace and conducts DCI operations within it. This design combines retriever-level recall with DCI-style precision: retrieval keeps exploration scalable, while DCI preserves the local operations needed for effective evidence resolution. Experiments show that DR-DCI is both effective and efficient across scales. On Browsecomp-Plus, DR-DCI reaches 71.2\% accuracy, improving over raw DCI and ablated variants by up to 8.3 points while reducing tool usage, wall time, and estimated cost. With workspace-preserving context reset, accuracy further improves to 73.3\%. In corpus-scaling experiments, DR-DCI remains effective from 100K to 10M documents, whereas raw DCI becomes unstable and BM25 performs substantially worse. DR-DCI also scales to a 20M-scale file-per-document Wiki-18 QA setting, achieving an average score of 63.0 across six benchmarks and outperforming retrieval-based and trained search-agent baselines. Ablation analysis further shows that ranked previews and inter-document DCI are key to performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。