arXiv:2411.15430cs.IRcs.DL2024-11被引 7

调研IIR领域数据重用现状,揭示研究者动机与评估策略

The Landscape of Data Reuse in Interactive Information Retrieval: Motivations, Sources, and Evaluation of Reusability

  • 通过21位IIR研究者深度访谈,分析数据重用动机与发现方式
  • 识别出数据可重用性的核心评估标准与实际挑战
  • 为构建可持续数据共享文化提供实证支持,适合数据治理研究者

共享与重用研究数据能有效减少小团队在数据收集与整理上的重复劳动,提升评估实验的可复现性。建立可持续的数据重用机制依赖于涵盖政策、标准、角色与责任的框架,需兼顾数据提供者、整理者与重用者的多元需求。为深化对数据重用的理解,本研究针对交互式信息检索(Interactive Information Retrieval, IIR)领域的资深研究者开展21次半结构化深度访谈,探讨其数据重用的动机、经验与顾虑。研究揭示了该领域研究者在重用他人数据时的动机、可重用性评估策略及面临的主要挑战,增强了对研究者数据重用行为、数据发现路径以及评估标准的认知,并丰富了关于用户生成数据与研究资源评估、推动社区级数据共享文化与标准的讨论。

原文摘要 · Abstract (English)

Sharing and reusing research data can effectively reduce redundant efforts in data collection and curation, especially for small labs and research teams conducting human-centered system research, and enhance the replicability of evaluation experiments. Building a sustainable data reuse process and culture relies on frameworks that encompass policies, standards, roles, and responsibilities, all of which must address the diverse needs of data providers, curators, and reusers. To advance the knowledge and accumulate empirical understandings on data reuse, this study investigated the data reuse practices of experienced researchers from the area of Interactive Information Retrieval (IIR) studies, where data reuse has been strongly advocated but still remains a challenge. To enhance the knowledge on data reuse behavior and reusability assessment strategies within IIR community, we conducted 21 semi-structured in-depth interviews with IIR researchers from varying demographic backgrounds, institutions, and stages of careers on their motivations, experiences, and concerns over data reuse. We uncovered the reasons, strategies of reusability assessments, and challenges faced by data reusers within the field of IIR as they attempt to reuse researcher data in their studies. The empirical finding improves our understanding of researchers' motivations for reusing data, their approaches to discovering reusable research data, as well as their concerns and criteria for assessing data reusability, and also enriches the on-going discussions on evaluating user-generated data and research resources and promoting community-level data reuse culture and standards.

数据重用IIR访谈研究科研协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。