arXiv:2409.08522cs.SIcs.CL2024-09

MAPX通过动态评估特征质量,提升假新闻检测的可解释性与准确性。

MAPX: An explainable model-agnostic framework for the detection of false information on social media networks

  • 基于证据融合的可解释聚合框架,动态考虑特征质量变化
  • 在多个基准数据集上超越现有最先进模型性能
  • 适合需要高可信度决策的社交媒体内容审核场景

自动化虚假信息检测已成为应对在线社交网络(OSMN)中‘假新闻’传播的关键任务,减少了对个体人工判断的依赖。现有研究虽利用了文档的内容或上下文特征,但大多将这些特征孤立使用,忽视了现实中普遍存在的时序与动态变化,限制了模型鲁棒性。此外,极少关注文档特征质量对最终预测可信度的影响。本文提出一种新型模型无关框架MAPX,实现对已有模型预测结果的基于证据的可解释聚合。该聚合方法具备自适应性、动态性,并考量了OSMN文档特征的质量。我们在多个基准假新闻数据集上进行了广泛实验,验证了MAPX在多种真实数据质量场景下的有效性。实证结果表明,所提框架始终优于所有评估的前沿模型。为保证可复现性,MAPX的演示代码已公开于GitHub。

原文摘要 · Abstract (English)

The automated detection of false information has become a fundamental task in combating the spread of "fake news" on online social media networks (OSMN) as it reduces the need for manual discernment by individuals. In the literature, leveraging various content or context features of OSMN documents have been found useful. However, most of the existing detection models often utilise these features in isolation without regard to the temporal and dynamic changes oft-seen in reality, thus, limiting the robustness of the models. Furthermore, there has been little to no consideration of the impact of the quality of documents' features on the trustworthiness of the final prediction. In this paper, we introduce a novel model-agnostic framework, called MAPX, which allows evidence based aggregation of predictions from existing models in an explainable manner. Indeed, the developed aggregation method is adaptive, dynamic and considers the quality of OSMN document features. Further, we perform extensive experiments on benchmarked fake news datasets to demonstrate the effectiveness of MAPX using various real-world data quality scenarios. Our empirical results show that the proposed framework consistently outperforms all state-of-the-art models evaluated. For reproducibility, a demo of MAPX is available at \href{https://github.com/SCondran/MAPX_framework}{this link}

假新闻检测可解释性特征质量动态聚合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。