让审稿意见可验证，自动找证据并标注在论文上
Peerispect: Claim Verification in Scientific Peer Reviews
- 从审稿意见中提取可核查的陈述，用论文内容找证据
- 通过自然语言推理判断陈述是否成立，结果可视化呈现
- 模块化设计，适合审稿人、作者和会议委员会使用
学术出版依赖同行评审，但审稿人常提出主观、修辞性或与稿件不符的陈述。评估这些陈述是否真实可验证，对公平性和问责制至关重要。在现代会议和期刊的规模下，人工核查这些陈述的依据已不可行。我们提出 Peerispect，一个交互式系统，通过从审稿意见中提取可核查的陈述，从论文中检索相关证据，并利用自然语言推理进行验证，将结果以可视化界面呈现，直接在论文中标注证据，支持快速审查与理解。Peerispect 采用模块化信息检索（IR）流水线，支持多种检索器、重排序器和验证器，适用于审稿人、作者和程序委员会。我们通过一个公开可访问的演示（https://app.reviewer.ly/app/peerispect）和 API 服务（https://github.com/Reviewerly-Inc/Peerispect），以及视频教程（https://www.youtube.com/watch?v=pc9RkvkUh14）展示了其应用。
原文摘要 · Abstract (English)
Peer review is central to scientific publishing, yet reviewers frequently include claims that are subjective, rhetorical, or misaligned with the submitted work. Assessing whether review statements are factual and verifiable is crucial for fairness and accountability. At the scale of modern conferences and journals, manually inspecting the grounding of such claims is infeasible. We present Peerispect, an interactive system that operationalizes claim-level verification in peer reviews by extracting check-worthy claims from peer reviews, retrieving relevant evidence from the manuscript, and verifying the claims through natural language inference. Results are presented through a visual interface that highlights evidence directly in the paper, enabling rapid inspection and interpretation. Peerispect is designed as a modular Information Retrieval (IR) pipeline, supporting alternative retrievers, rerankers, and verifiers, and is intended for use by reviewers, authors, and program committees. We demonstrate Peerispect through a live, publicly available demo (https://app.reviewer.ly/app/peerispect) and API services (https://github.com/Reviewerly-Inc/Peerispect), accompanied by a video tutorial (https://www.youtube.com/watch?v=pc9RkvkUh14).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。