arXiv:2603.08117cs.AIcs.IR2026-03被引 1

提出首个针对未索引信息搜索的评测基准与多智能体系统。

UIS-Digger: Towards Comprehensive Research Agent Systems for Real-world Unindexed Information Seeking

  • 设计双模式浏览框架,同步搜索网页与解析文件。
  • 在未索引数据集上表现优于顶尖模型,达27.27%准确率。
  • 适合研究信息检索鲁棒性与智能体交互的新方向。

基于大模型的信息检索智能体虽在传统基准上表现优异,但严重依赖搜索引擎索引知识,存在关键盲区:未索引信息搜索(UIS)。本文定义并探索该问题,即被爬虫忽略的内容、动态网页和嵌入文件等重要信息。为填补空白,提出首个专用评测集UIS-QA,包含110对专家标注的问答对。即使最先进模型在该集上性能骤降(如GAIA上从70.90降至24.55),凸显问题严峻性。为此提出UIS-Digger框架,采用双模式浏览,支持页面搜索与文件解析并行。使用约300亿参数的骨干模型,经SFT与RFT训练,在不依赖复杂模型的前提下达到27.27%准确率,超越O3和GPT-4.1等系统。结果表明主动接触未索引源对全面信息获取至关重要。本工作不仅揭示当前评估范式的根本局限,还首次提供推进UIS研究的工具包,开辟了构建更鲁棒信息系统的全新路径。数据集已发布于:https://huggingface.co/datasets/UIS-Digger/UIS-QA。

原文摘要 · Abstract (English)

Recent advancements in LLM-based information-seeking agents have achieved record-breaking performance on established benchmarks. However, these agents remain heavily reliant on search-engine-indexed knowledge, leaving a critical blind spot: Unindexed Information Seeking (UIS). This paper identifies and explores the UIS problem, where vital information is not captured by search engine crawlers, such as overlooked content, dynamic webpages, and embedded files. Despite its significance, UIS remains an underexplored challenge. To address this gap, we introduce UIS-QA, the first dedicated UIS benchmark, comprising 110 expert-annotated QA pairs. Notably, even state-of-the-art agents experience a drastic performance drop on UIS-QA (e.g., from 70.90 on GAIA and 46.70 on BrowseComp-zh to 24.55 on UIS-QA), underscoring the severity of the problem. To mitigate this, we propose UIS-Digger, a novel multi-agent framework that incorporates dual-mode browsing and enables simultaneous webpage searching and file parsing. With a relatively small $\sim$30B-parameter backbone LLM optimized using SFT and RFT training strategies, UIS-Digger sets a strong baseline at 27.27\%, outperforming systems integrating sophisticated LLMs such as O3 and GPT-4.1. This demonstrates the importance of proactive interaction with unindexed sources for effective and comprehensive information-seeking. Our work not only uncovers a fundamental limitation in current agent evaluation paradigms but also provides the first toolkit for advancing UIS research, defining a new and promising direction for robust information-seeking systems. The dataset has been released at: https://huggingface.co/datasets/UIS-Digger/UIS-QA.

信息检索多智能体未索引信息

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。