arXiv:2509.00728cs.IRcs.DB2025-09综述被引 4

LLM时代下开放数据集搜索的系统综述,解析智能检索新范式。

A Survey on Open Dataset Search in the LLM Era: Retrospectives and Perspectives

  • 融合大模型实现基于内容的语义搜索与查询理解
  • 提升多模态数据集检索效率与精准度,支持RAG与数据筛选
  • 适合关注数据智能、检索增强生成的研究者与开发者

高质量数据集是完成数据驱动任务(如医学诊断模型训练、实时交通预测、研究假设验证)的关键。开放数据集搜索旨在高效准确地满足用户的数据需求,已成为重要研究挑战并引发广泛关注。近年来,研究在提升搜索灵活性与智能化方面取得进展,大语言模型(LLMs)在解决长期存在的查询理解、语义建模与交互引导等难题中展现出强大潜力。本综述聚焦传统元数据与关键词搜索之外的最新进展,从数据模态角度,重点探讨基于实例的搜索、基于数据内容的高级相似性度量方法以及高效搜索加速技术。同时强调LLMs与开放数据集搜索的协同关系:一方面,LLMs助力复杂查询理解与语义建模;另一方面,数据搜索进步可推动LLMs在检索增强生成(RAG)与数据选择中的应用,提升下游任务性能。最后,总结开放问题,展望未来方向,为该领域研究者与实践者提供结构化参考。

原文摘要 · Abstract (English)

High-quality datasets are typically required for accomplishing data-driven tasks, such as training medical diagnosis models, predicting real-time traffic conditions, or conducting experiments to validate research hypotheses. Consequently, open dataset search, which aims to ensure the efficient and accurate fulfillment of users' dataset requirements, has emerged as a critical research challenge and has attracted widespread interest. Recent studies have made notable progress in enhancing the flexibility and intelligence of open dataset search, and large language models (LLMs) have demonstrated strong potential in addressing long-standing challenges in this area. Therefore, a systematic and comprehensive review of the open dataset search problem is essential, detailing the current state of research and exploring future directions. In this survey, we focus on recent advances in open dataset search beyond traditional approaches that rely on metadata and keywords. From the perspective of dataset modalities, we place particular emphasis on example-based dataset search, advanced similarity measurement techniques based on dataset content, and efficient search acceleration techniques. In addition, we emphasize the mutually beneficial relationship between LLMs and open dataset search. On the one hand, LLMs help address complex challenges in query understanding, semantic modeling, and interactive guidance within open dataset search. In turn, advances in dataset search can support LLMs by enabling more effective integration into retrieval-augmented generation (RAG) frameworks and data selection processes, thereby enhancing downstream task performance. Finally, we summarize open research problems and outline promising directions for future work. This work aims to offer a structured reference for researchers and practitioners in the field of open dataset search.

数据搜索大模型RAG综述

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。