评测多语言新闻生成与检索,13支团队参与125项实验。
Overview of the TREC 2025 RAGTIME Track
- 构建阿拉伯、中文、英文、俄文新闻语料库,支持多语言报告生成。
- 涵盖三类任务,共125个提交结果,含基线对比。
- 适合关注多语言信息处理与生成评估的研究者。
TREC 2025 RAGTIME 赛道旨在研究从多语言源文档生成报告的任务。该赛道构建了一个包含阿拉伯语、中文、英文和俄文新闻故事的文档集合。RAGTIME 设立了三项任务:多语言报告生成、英文报告生成以及多语言信息检索(MLIR)。共有13支参赛队伍(及赛道组织者提供的基线)提交了总计125项运行结果。本文概述了这三项任务,并呈现了已有的评估结果。
原文摘要 · Abstract (English)
The principal goal of the RAG TREC Instrument for Multilingual Evaluation (RAGTIME) track at TREC is to study report generation from multilingual source documents. The track has created a document collection containing Arabic, Chinese, English, and Russian news stories. RAGTIME includes three task types: Multilingual Report Generation, English Report Generation, and Multilingual Information Retrieval (MLIR). A total of 125 runs were submitted by 13 participating teams (and as baselines by the track coordinators) for three tasks. This overview describes these three tasks and presents the available results.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。