arXiv:2608.14571cs.AIcs.DL2026-08

用积分制激励优质审稿,解决机器学习领域评审体验差的问题。

Position: Want Better ML Reviews? Stop Asking Nicely and Start Incentivizing with a Credit System

  • 设计可执行的细粒度审查规则与积分系统
  • 优质审稿可积累积分,用于兑换会议权益
  • 适合关注学术评审改革的研究者和会议组织者

随着投稿量激增、同行评审政策趋严以及OpenReview等平台广泛使用,机器学习领域已成为科学界最具影响力的学术阵地之一。然而,几乎所有参与者都对评审体验感到不满,且缺乏公开讨论评审系统改进的空间。本文聚焦两大核心问题:如何合理控制投稿量?如何激励优质评审、遏制低质行为?我们评估了现有机制的优劣,提出四种现有做法的分析及两种改进方案。主张仅靠温和建议无法推动实质性变革,必须引入可执行的程序保障与类货币积分体系(如提出的OpenReview Points)。研究者可通过高质量评审积累积分,用于兑换会议注册减免或额外评审资源等权益。

原文摘要 · Abstract (English)

With soaring submission counts, stricter reciprocal review policies, widespread adoption of platforms like OpenReview, and without the offsetting pressure of publication fees, the machine learning (ML) community has one of the largest scholarly presences among all scientific fields. And yet, \textbf{almost \textit{everyone} has \textit{many} unpleasant things to share about their review experience.} Worse, there is little public space to seriously discuss, let alone debate, what makes a review system effective or how it might be improved.\quad In this position paper, we expand our discussion from two core problems: \textit{How can we reasonably limit submission volume?} and \textit{How can we incentivize good and discourage bad reviewing?} We first assess the strengths and shortcomings of existing attempts to address such problems. Specifically, we present four takes on some popular conference mechanisms and propose two alternative designs for improvement.\quad Our general position is that meaningful improvement in ML peer review won't come from polite best-practice suggestions tucked into Calls for Papers or Reviewer Guidelines: it requires \textbf{enforceable yet fine-grained procedural safeguards} paired with \textbf{a currency-like credit system (e.g., our proposed \textit{OpenReview Points})}. ML practitioners can ``earn'' such points by contributing good review practices, and ``spend'' them across one or multiple major conferences to redeem different kinds of ``perks,'' such as complimentary registration or the right to request additional review resources.

学术评审积分系统机器学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。