用AI工具自动比对研究注册与论文,提升科研透明度。
RegCheck: A tool for structured comparisons between study registrations and papers
- 基于大模型构建可定制的对比工具,由人主导判断差异
- 生成带唯一ID的可共享报告,便于验证与协作
- 适用于多领域、多格式,助力可复现科学研究
在社会科学与医学领域,研究者普遍认为预先注册研究计划能提升科学透明度与严谨性。然而,现有证据显示,研究注册常被忽视,难以发挥应有作用。这不难理解:人工核对注册信息与论文内容耗时耗力,需跨格式阅读与跨领域知识。AI的出现为解决这一难题带来新可能。本文提出RegCheck,一种模块化的大语言模型辅助工具,旨在帮助研究人员、审稿人和编辑跨学科比较研究注册与对应论文。关键在于,该工具将人类判断置于核心:一是由用户决定对比哪些特征,二是仅展示相关文本片段,辅助而非取代人工判断。此外,RegCheck生成带唯一标识符的可共享报告,支持快速验证与协作。该工具具备跨领域、跨注册与发表格式的适应性。本文介绍其设计动机、工作流程与原则,并以实例展示其作为可扩展基础设施在可复现科学中的潜力。
原文摘要 · Abstract (English)
Across the social and medical sciences, researchers recognize that specifying planned research activities (i.e., 'registration') prior to the commencement of research has benefits for both the transparency and rigour of science. Despite this, evidence suggests that study registrations frequently go unexamined, minimizing their effectiveness. In a way this is no surprise: manually checking registrations against papers is labour- and time-intensive, requiring careful reading across formats and expertise across domains. The advent of AI unlocks new possibilities in facilitating this activity. We present RegCheck, a modular LLM-assisted tool designed to help researchers, reviewers, and editors from across scientific disciplines compare study registrations with their corresponding papers. Importantly, RegCheck keeps human expertise and judgement in the loop by (i) ensuring that users are the ones who determine which features should be compared, and (ii) presenting the most relevant text associated with each feature to the user, facilitating (rather than replacing) human discrepancy judgements. RegCheck also generates shareable reports with unique RegCheck IDs, enabling them to be easily shared and verified by other users. RegCheck is designed to be adaptable across scientific domains, as well as registration and publication formats. In this paper we provide an overview of the motivation, workflow, and design principles of RegCheck, and we discuss its potential as an extensible infrastructure for reproducible science with an example use case.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。