arXiv:2409.18024cs.IR2024-09被引 5

总结信息检索模拟工作坊,探讨用户模拟的实践价值与评估融合前景。

Report on the Workshop on Simulations for Information Access (Sim4IA 2024) at SIGIR 2024

  • 组织了主题报告、圆桌讨论、闪电演讲与分组研讨
  • 提出用户模拟在学术与工业界的重要性及评估方法融合可能
  • 指出围绕用户模拟举办共用评测任务的组织挑战

本文为2024年SIGIR会议中信息检索模拟研讨会(Sim4IA 2024)的综述报告。研讨会包含两场主旨报告、一场圆桌讨论、九场闪电演讲和两场分组讨论。主要收获包括:用户模拟在学术与工业界的重要性日益凸显;在线与离线评估之间存在融合潜力;围绕用户模拟开展共用评测任务面临组织难题。报告详细说明了研讨会的组织方式,概述了现场活动内容,并总结了核心议题与未来研究方向。

原文摘要 · Abstract (English)

This paper is a report of the Workshop on Simulations for Information Access (Sim4IA) workshop at SIGIR 2024. The workshop had two keynotes, a panel discussion, nine lightning talks, and two breakout sessions. Key takeaways were user simulation's importance in academia and industry, the possible bridging of online and offline evaluation, and the issues of organizing a companion shared task around user simulations for information access. We report on how we organized the workshop, provide a brief overview of what happened at the workshop, and summarize the main topics and findings of the workshop and future work.

信息检索用户模拟评估方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。