实时识别新闻事件,自动归类到具体故事中。
Real-time News Story Identification
- 融合文本表示与在线主题模型,实时识别新闻中的具体事件
- 在斯洛文尼亚媒体数据集上,人类评估认为结果合理
- 适合需要即时新闻聚合的监测系统使用
为提升阅读体验,许多新闻网站将新闻按主题归类,称为故事。本文提出一种实时新闻故事识别方法,用于新闻监控系统,该系统可自动收集线上出现的新闻并实时处理。故事识别旨在将每篇新闻文章分配到其所报道的具体故事中。该任务类似于文本聚类和主题建模,但要求根据特定事件、地点和人物分组,而非基于一般文本相似性(如聚类)或预定义主题(如主题建模)。本文提出的方法结合了文本表示技术、聚类算法与在线主题建模方法,通过混合使用BERTopic、DBStream和TextClust等在线主题模型,有效提取事件与命名实体。在覆盖一个月期的斯洛文尼亚媒体数据集上进行评估,结果显示该实时方法经人工评判结果合理。
原文摘要 · Abstract (English)
To improve the reading experience, many news sites organize news into topical collections, called stories. In this work, we present an approach for implementing real-time story identification for a news monitoring system that automatically collects news articles as they appear online and processes them in various ways. Story identification aims to assign each news article to a specific story that the article is covering. The process is similar to text clustering and topic modeling, but requires that articles be grouped based on particular events, places, and people, rather than general text similarity (as in clustering) or general (predefined) topics (as in topic modeling). We present an approach to story identification that is capable of functioning in real time, assigning articles to stories as they are published online. In the proposed approach, we combine text representation techniques, clustering algorithms, and online topic modeling methods. We combine various text representation methods to extract specific events and named entities necessary for story identification, showing that a mixture of online topic-modeling approaches such as BERTopic, DBStream, and TextClust can be adapted for story discovery. We evaluate our approach on a news dataset from Slovene media covering a period of 1 month. We show that our real-time approach produces sensible results as judged by human evaluators.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。