arXiv:2505.11687cs.IRcs.AI2025-05被引 6

聚焦信息检索模拟,推动交互式评估与可复现研究

Second SIGIR Workshop on Simulations for Information Access (Sim4IA 2025)

  • 构建信息检索仿真系统,替代真实用户参与实验
  • 支持伦理受限场景下的评估,提升实验可复现性
  • 面向研究者与实践者,共议未来方向与评测计划

信息获取(IA)中的仿真技术近年受到广泛关注,体现在相关教程与研讨会的兴起。仿真在交互式场景中尤为关键,当真实用户无法参与或出于伦理考量不可行时,可作为核心研究与评估工具。此外,仿真有助于深入理解用户行为、降低评估实验复杂度,并提升结果可复现性。基于近期方法与工具包的发展,第二届Sim4IA workshop旨在再次汇聚研究者与从业者,打造一个互动活跃的讨论平台,探讨该领域的未来前景,并规划即将开展的TREC/CLEF评测活动。

原文摘要 · Abstract (English)

Simulations in information access (IA) have recently gained interest, as shown by various tutorials and workshops around that topic. Simulations can be key contributors to central IA research and evaluation questions, especially around interactive settings when real users are unavailable, or their participation is impossible due to ethical reasons. In addition, simulations in IA can help contribute to a better understanding of users, reduce complexity of evaluation experiments, and improve reproducibility. Building on recent developments in methods and toolkits, the second iteration of our Sim4IA workshop aims to again bring together researchers and practitioners to form an interactive and engaging forum for discussions on the future perspectives of the field. An additional aim is to plan an upcoming TREC/CLEF campaign.

信息检索仿真评估可复现性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。