arXiv:2607.27726cs.AIcs.CL2026-07

用结构化搜索提升大模型在海量异构数据中系统性研究的能力

Baikal: Structured Search for Deep Research over Data Lakes

  • 将跨表跨段的深搜任务建模为带预算的搜索问题,按语义区域分组证据并自适应探索
  • 在两个数据湖上实验,相比最强基线报告质量提升28%至36%,显著改善事实准确性和多样性
  • 适合需要深度调研、多源信息整合的研究者或智能助手开发者使用

在数据湖上进行深度研究需让大模型跨越数千个异构表格和段落寻找证据并生成报告。现有方法采用迭代检索与生成,依赖累积上下文决定下一步调查方向,易过度聚焦局部高回报证据,难以覆盖多样语义区域。为此,本文将该任务视为带预算的搜索问题,提出Baikal框架:先将异构证据聚类为语义区域,再自适应地选择区域探索,平衡探索与利用。每个选定区域内,生成并调查基于区域的子问题,以发现质量作为奖励更新区域价值估计,指导搜索策略(如随机、LLM引导、贝叶斯ε-贪心、UCB)。我们在HybridQA(10,993张表)和TAT-QA(2,757张表)数据湖上评估,包含22.7万维基段落和1.3万金融报告段落。使用新制定的评分标准(覆盖可据性、相关性、多样性、实用性)及GPT-5-mini评估,结果显示,不同区域选择策略下Baikal表现优异;最佳配置在HybridQA上比最强基线提升28%,在TAT-QA上提升36%。分析表明,其优势源于对语义区域的组织与探索,提升了可据性、多样性,并产出更实用发现,证明结构化语义探索对系统性研究的价值。

原文摘要 · Abstract (English)

Deep research over data lakes requires an LLM agent to investigate evidence across thousands of heterogeneous tables and passages to synthesize a report. Existing methods perform iterative retrieval and generation, letting accumulated context determine what to investigate next, which can overexploit locally promising evidence and fail to cover distinct semantic regions under a fixed budget. To address this, we cast deep research over data lakes as a budgeted search problem and present Baikal - a framework that clusters heterogeneous evidence into semantic regions, then searches over them adaptively to balance exploration and exploitation. Within each selected region, Baikal generates and investigates region-grounded subquestions, using finding quality as rewards to update region-level value estimates and guide search under policies ranging from random and LLM-guided selection to Bayesian $ε$-greedy and UCB. We evaluate Baikal on 15 queries each over HybridQA and TAT-QA data lakes containing 10,993 and 2,757 tables, respectively, together with 227K Wikipedia passages and 13K financial report passages. We assess research quality with a new rubric covering groundedness, relevance, diversity, and utility, and use GPT-5-mini to score Baikal and strong baselines, including DeepSearcher and an OpenCode research agent with retrieval and clustering variants. Across both data lakes, Baikal performs strongly under several region-selection policies; its best configuration improves report scores over the strongest baselines by 28% on HybridQA and 36% on TAT-QA. Our analyses attribute these gains to organizing and exploring semantic evidence regions, which improves groundedness and diversity and yields more useful findings under the same subquestion budget. These results demonstrate the value of structured semantic exploration for systematic research and discovery over heterogeneous data lakes.

大模型研究数据湖智能搜索语义探索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。