分析顶会立场论文投稿,发现多数是批评现有方法,建议增加开创性工作。
An Investigation of the NeurIPS and ICML 2025 Position Tracks
- 通过预设标准审计2025年顶会立场论文投稿
- 75%的投稿聚焦批评现有基准或方法,但证据深度不决定评分
- 强调应鼓励提出新基准、新工具等开创性成果,而非仅限批判
机器学习顶会塑造了哪些研究主张可被评审理解,以及何种证据被视为严谨。NeurIPS与ICML的立场论文赛道旨在推动议程设定,其早期构成值得审查。本文指出,当前公开可查的2025年评审稿件以改革式批评为主,建议该赛道应明确征集方向性工作,而非替代现有的批判性内容。我们依据预设标准审计了所有可获取的NeurIPS 2025与ICML 2025立场论文投稿,并与一批公认的议程变革型论文(如AlexNet、Transformer、Concrete Problems in AI Safety等)进行对比。结果显示,75%的投稿针对现有基准、评估或方法进行批判;这些论文在‘成果耦合’指标上得分高,但证据深度与评审评分无显著关联。参考文献中议程变革类论文通常提供了新工具:如测量协议、基准提案、原型实现、数据集卡片、审计模板或可证伪的实验方案,供领域构建、测试或辩论。最后提出四项征稿倡议,旨在拓宽投稿类型,同时保留原有批判性内容的优势。
原文摘要 · Abstract (English)
ML venues shape what kinds of research claims become legible to reviewers and what forms of evidence count as rigorous. The NeurIPS and ICML Position Paper Tracks were created for agenda-setting work, making their early composition worth auditing. \textbf{This paper argues that the publicly accessible 2025 reviewed pool is dominated by reformist critique, and that the track should explicitly solicit direction-setting work alongside, not in place of, the reformist critiques it already hosts well.} We audit every accessible submission to the NeurIPS 2025 and ICML 2025 Position Tracks under a pre-specified rubric, and compare the resulting pattern with a reference class of widely recognized agenda-shifting ML papers. Three-quarters of audited submissions critique an existing benchmark, evaluation, or methodology; these papers score highly on our artifact-coupling rubric, but evidentiary depth does not predict reviewer rating. The reference class (AlexNet, the Transformer, Concrete Problems in AI Safety, and others) differs from the accessible reviewed pool in \emph{artifact kind}: agenda-shifting papers typically gave the field something new to build on, test against, or contest, such as a measurement protocol, benchmark proposal, toy implementation, dataset card, audit template, or falsifiable experimental program. We close with four CFP-level interventions aimed at broadening the submission mix without displacing the critiques the track already hosts well.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。