分析论文摘要可读性变化，发现ChatGPT发布后科学写作变得更复杂。
Exploring the change in scientific readability following the release of ChatGPT
- 用四种可读性公式分析arXiv 2010–2024年摘要，按年份和学科分类评估。
- 发现可读性逐年下降，2023及2024年前半年出现显著恶化趋势。
- 多数学科在2023–2024年均出现可读性明显变化，暗示AI影响科学写作。
大型语言模型的普及引发了对其对科研写作与发表影响的讨论。本文分析了2010年至2024年6月7日间arXiv.org上所有论文摘要，评估其可读性演变，并检验ChatGPT于2022年11月发布后是否引发显著变化。采用四种标准可读性公式计算每篇论文的得分，按年份及平台覆盖的八个主要学科分类汇总。结果表明，可读性呈逐年下降趋势，且2023年及2024年已分析月份中出现显著变化。各学科均呈现类似趋势，多数在2023至2024年间可读性发生明显降低。研究揭示了科学写作可读性的长期变迁，并提示人工智能可能正在影响学术表达方式。
原文摘要 · Abstract (English)
The rise and growing popularity of accessible large language models have raised questions about their impact on various aspects of life, including how scientists write and publish their research. The primary objective of this paper is to analyze a dataset consisting of all abstracts posted on arXiv.org between 2010 and June 7th, 2024, to assess the evolution of their readability and determine whether significant shifts occurred following the release of ChatGPT in November 2022. Four standard readability formulas are used to calculate individual readability scores for each paper, classifying their level of readability. These scores are then aggregated by year and across the eight primary categories covered by the platform. The results show a steady annual decrease in readability, suggesting that abstracts are likely becoming increasingly complex. Additionally, following the release of ChatGPT, a significant change in readability is observed for 2023 and the analyzed months of 2024. Similar trends are found across categories, with most experiencing a notable change in readability during 2023 and 2024. These findings offer insights into the broader changes in readability and point to the likely influence of AI on scientific writing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。