用多智能体蒸馏生成有依据、可追溯的科学审稿,效率更高。
EGTR-Review: Efficient Evidence-Grounded Scientific Peer Review Generation via Multi-Agent Teacher Distillation

- 构建多智能体教师分步拆解论文并检索学术证据
- 蒸馏出轻量学生模型,在多项评测中超越基线
- 适合需要高效可靠审稿辅助的研究者与期刊
科学同行评审生成因能减轻审稿负担、提供及时反馈而受到关注。然而,现有基于大语言模型的方法常产生缺乏证据支持且溯源能力弱的通用评论,而复杂的多智能体系统则带来高推理成本。为此,我们提出EGTR-Review:一种通过多智能体教师蒸馏实现证据锚定与可追溯的审稿生成框架。该框架首先构建多智能体教师,执行结构感知的论文分解、关键要素提取、外部学术证据检索、证据状态标注、验证推理与审稿合成;随后通过任务前缀驱动的多任务学习,将中间推理轨迹和最终审稿内容蒸馏至轻量学生模型,并引入证据加权目标以降低弱监督或缺失监督的影响。在公开审稿数据集上的实验表明,EGTR-Review(学生模型)在自动指标、LLM作为裁判的评估及人工评估中均优于强基线,同时保持强事实依据性和源可追溯性,且显著降低令牌消耗与推理时间。代码、提示、配置与样例数据已开源。
原文摘要 · Abstract (English)
Scientific peer review generation has attracted increasing attention for reducing reviewing burdens and providing timely feedback. However, existing Large Language Model (LLM)-based methods often produce generic comments with insufficient evidence support and weak source traceability, while complex multi-agent systems incur high inference costs. To address these challenges, we propose EGTR-Review, an Evidence-Grounded and Traceable Review Generation framework via Multi-Agent Teacher Distillation. EGTR-Review first constructs a multi-agent teacher that performs structure-aware paper decomposition, key-element extraction, external scholarly evidence retrieval, evidence-state labeling, verification reasoning, and review synthesis. It then distills both intermediate reasoning trajectories and final review comments into a lightweight student model through task-prefix-driven multi-task learning. An evidence-weighted objective further reduces the influence of weak, missing, or non-verifiable supervision. Experiments on public peer-review datasets show that EGTR-Review (Student) outperforms strong prompt-based, fine-tuned, and structured/agentic baselines across automatic metrics, LLM-as-Judge evaluation, and human evaluation, while maintaining strong factual grounding and source traceability with substantially lower token consumption and inference time. Our code, prompts, configurations, and sample data are available on GitHub.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。