解决用户记不住名字却能描述细节的检索难题,提升难找信息的召回能力。
Overview of the TREC 2025 Tip-of-the-Tongue track
- 基于真实用户描述的复杂查询,构建多源测试集进行检索。
- 9个团队提交32次运行,覆盖真实、人工与大模型生成查询。
- 适用于需要精准理解模糊描述的搜索系统优化场景。
Tip-of-the-tongue(ToT)已知项检索指用户无法准确回忆标识符但仍能描述信息的情形。此类查询通常冗长且包含多种复杂现象,对现有信息检索系统构成挑战。TREC 2025 ToT赛道聚焦单一即席检索任务,今年扩展至通用领域,并引入来自MS-ToT数据集、人工主题开发及大模型生成的多源测试查询。共有9个团队(含赛道协调方)提交了32次运行结果。
原文摘要 · Abstract (English)
Tip-of-the-tongue (ToT) known-item retrieval involves re-finding an item for which the searcher does not reliably recall an identifier. ToT information requests (or queries) are verbose and tend to include several complex phenomena, making them especially difficult for existing information retrieval systems. The TREC 2025 ToT track focused on a single ad-hoc retrieval task. This year, we extended the track to general domain and incorporated different sets of test queries from diverse sources, namely from the MS-ToT dataset, manual topic development, and LLM-based synthetic query generation. This year, 9 groups (including the track coordinators) submitted 32 runs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。