分析聊天机器人发布对新闻标题风格的影响，发现影响有限。
Did ChatGPT or Copilot use alter the style of internet news headlines? A time series regression analysis
- 用175个NLP特征分析4.5亿条新闻标题，检测风格变化。
- 仅91个特征在发布后出现显著变化，且部分与旧模型相关。
- 适合关注AI对内容创作影响的研究者和媒体从业者。
ChatGPT与Copilot等先进大语言模型的发布正改变文本生成方式，可能影响网络内容。本研究通过分析全球新闻网站的4.5亿条标题/链接数据，提取175个NLP特征，采用中断时间序列分析法，评估其发布前后是否存在持续风格变化。结果显示，44个特征未见显著变化；另有91个特征显示显著变化，但其中部分在早期模型（如GPT-1/2/3、Gopher）发布时已存在，故被排除。初步表明，这些大语言模型对新闻标题/链接的写作风格影响有限，仅体现在少数NLP度量上。
原文摘要 · Abstract (English)
The release of advanced Large Language Models (LLMs) such as ChatGPT and Copilot is changing the way text is created and may influence the content that we find on the web. This study investigated whether the release of these two popular LLMs coincided with a change in writing style in headlines and links on worldwide news websites. 175 NLP features were obtained for each text in a dataset of 451 million headlines/links. An interrupted time series analysis was applied for each of the 175 NLP features to evaluate whether there were any statistically significant sustained changes after the release dates of ChatGPT and/or Copilot. There were a total of 44 features that did not appear to have any significant sustained change after the release of ChatGPT/Copilot. A total of 91 other features did show significant change with ChatGPT and/or Copilot although significance with earlier control LLM release dates (GPT-1/2/3, Gopher) removed them from consideration. This initial analysis suggests these language models may have had a limited impact on the style of individual news headlines/links, with respect to only some NLP measures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。