arXiv:2606.25057cs.CL2026-06综述被引 1

用大模型辅助学术审稿,但存在安全与可靠性风险。

LLM-Based Scientific Peer Review: Methods, Benchmarks, and Reliability Challenges

论文配图:LLM-Based Scientific Peer Review: Methods, Benchmarks, and Reliability Challenges
图 1 · 摘自论文原文
  • 分类梳理了提示、监督、检索增强等审稿模型方法
  • 发现现有评测存在数据偏差和评估不足问题
  • 揭示了提示注入等安全风险,适合研究AI评审系统者参考

科学论文投稿量激增已逼近传统同行评审的可扩展极限,推动大语言模型(LLMs)作为智能自动化评估助手的探索。尽管近期研究显示LLMs能生成流畅评语并近似评分,但其作为决策支持系统的可靠性、鲁棒性与安全性仍不明确。本综述从系统层面分析基于LLM的科学同行评审,聚焦两大核心功能:评语生成与评分预测。提出建模方法的结构化分类(包括提示式、监督式、检索增强式、对齐优化式),整合现有基准的实证发现。分析数据集局限、评估缺陷及领域集中偏差对当前评估实践的制约。除性能指标外,识别出新型鲁棒性风险,如提示注入、数据投毒、检索漏洞和奖励劫持,暴露自动化评审流程易受策略性操控。从数据挖掘视角,指出建模主观分歧与跨域泛化的关键挑战。通过将自动审稿重构为高风险、多目标决策问题,本综述为构建鲁棒、透明、可信的AI辅助科学评价体系提供路线图。

原文摘要 · Abstract (English)

The rapid growth of scientific submissions has pushed traditional peer review toward its scalability limits, motivating the exploration of large language models (LLMs) as intelligent automated evaluation assistants. Although recent studies show that LLMs can generate fluent critiques and approximate reviewer scores, their reliability, robustness, and security as decision-support systems remain insufficiently understood. This survey offers a systems-level analysis of LLM-based scientific peer review, focusing on two core evaluative functions: critique generation and score prediction. We present a structured taxonomy of modeling approaches (including prompt-based, supervised, retrieval-augmented, and alignment-optimized approaches), and synthesize empirical findings across existing benchmarks. We analyze dataset constraints, evaluation shortcomings, and domain concentration biases that limit current assessment practices. Beyond performance metrics, we identify emerging robustness risks, including prompt injection, data poisoning, retrieval vulnerabilities, and reward hacking, which expose automated review pipelines to strategic manipulation. From a data mining perspective, we outline key open challenges in modeling subjective disagreement and cross-domain generalization. By reframing automated peer review as a high-stakes, multi-objective decision problem, this survey provides a roadmap for developing robust, transparent, and trustworthy AI-assisted scientific evaluation systems.

AI审稿大模型可靠性安全风险

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。