arXiv:2602.11173cs.CL2026-02ACL综述被引 1

让作者主导论文回复生成,结合专家知识提升回应质量

Author-in-the-Loop Response Generation and Evaluation: Integrating Author Expertise and Intent in Responses to Peer Review

  • 构建作者参与式回复框架,支持输入控制与效果反馈
  • 实验证明作者输入能显著提升回复质量和针对性
  • 适合需要精准回应审稿意见的研究者和NLP工具开发者

作者回复(反驳)是科学同行评审的关键环节,耗费大量精力。作者拥有领域专长、独有信息和回应策略等隐含的专家知识与意图,亟需NLP工具整合这些信号进行回复生成。然而当前该作者主导范式缺乏系统性研究:无数据集提供细粒度作者信号,现有工作忽略作者输入与控制,且缺乏评估回复是否反映作者意图及解决审稿问题的有效性。为此,我们提出:(i) Re3Align,首个大规模对齐的审稿-回复-修改三元组数据集,以修改内容作为作者信号代理;(ii) REspGen,支持灵活作者输入、多属性控制与评估引导优化的作者主导回复生成框架;(iii) REspEval,包含20余项指标的综合评估套件,涵盖输入利用度、可控性、回复质量与话语连贯性。使用SOTA大模型的实验表明,作者输入与评估引导优化可显著提升回复质量,输入具体性影响回复效果,且存在可控性与质量间的权衡。我们已开源数据集、生成与评估工具。

原文摘要 · Abstract (English)

Author response (rebuttal) writing is a critical stage of scientific peer review that demands substantial author effort. In practice, authors possess domain expertise, author-only information, and response strategies - concrete forms of author expertise and intent - and seek NLP assistance that integrates these signals into author response generation (ARG). Yet this author-in-the-loop paradigm lacks formal NLP formulation and systematic study: no dataset provides fine-grained author signals, existing ARG work lacks author inputs and controls, and no evaluation measures response reflection of author signals and effectiveness in addressing reviewer concerns. To fill these gaps, we introduce (i) Re3Align, the first large-scale dataset of aligned review-response-revision triplets, where revisions proxy author signals; (ii) REspGen, an author-in-the-loop ARG framework supporting flexible author input, multi-attribute control, and evaluation-guided refinement; and (iii) REspEval, a comprehensive evaluation suite with 20+ metrics spanning input utilization, controllability, response quality, and discourse. Experiments with SOTA LLMs demonstrate the benefits of author input and evaluation-guided refinement, the impact of input specificity on response quality, and controllability-quality trade-offs. We release our dataset, generation and evaluation tools.

文本生成人机协同学术写作评估方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。