arXiv:2606.24188cs.CLcs.DL2026-06综述被引 1

分析论文评审中情感随轮次变化,发现越往后评价越积极。

Aspect-Based Sentiment Evolution and its Correlation with Review Rounds in Multi-Round Peer Reviews: A Deep Learning Approach

  • 用深度学习模型细粒度分析评审意见中的情感焦点
  • 82.65%准确率的模型显示正向情感随轮次增加
  • 实验、意义和结果分析是影响评分的关键方面

从同行评审文本中挖掘情感信息,有助于理解科学评价过程。然而以往研究多局限于粗粒度分析,且缺乏对多轮评审阶段的区分。本文针对11,063篇发表于《Nature Communications》的论文,分析其多轮评审意见,通过聚类识别出细粒度评审维度,并构建约5,000条人工标注语句的语料库。基于此训练深度学习模型,其中LCF-BERT-CDM达到82.65%的宏平均F1值。统计分析表明,随着评审轮次增加,正面情感比例上升,负面情感下降;相关性分析显示,情感得分与总评审轮次呈负相关,尤其在“实验”、“研究意义”和“结果分析”方面更为显著。

原文摘要 · Abstract (English)

Mining sentiment information from the textual content of peer review comments offers valuable insights into the scientific evaluation process. However, previous studies are often constrained by coarse-grained analysis and the lack of differentiation across review rounds. Notably, the dynamic shifts in reviewers' focus and sentiment tendencies throughout multiple review stages remain underexplored. To address this gap, the present study investigates the distribution and evolution of aspect-level sentiments and examines their correlation with the number of review rounds. We begin by segmenting the multi-round review comments of 11,063 accepted papers from Nature Communications and identifying fine-grained review aspect clusters. A manually annotated corpus of approximately 5,000 review sentences is then constructed. Using this dataset, we train a series of deep learning-based aspect sentiment classification models. Among them, the LCF-BERT-CDM model achieves the best performance, with a Macro-F1 score of 82.65%. Subsequent statistical analysis reveals a consistent trend: as the number of review rounds increases, the proportion of positive sentiments rises, while negative sentiments decline. Correlation analysis further indicates that aspect sentiment scores are negatively associated with the total number of review rounds. Key aspects exhibiting stronger correlations include "experiments", "research significance" and "result analysis".

情感分析评审机制深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。