融合机器与人工判断可靠性,提升社交平台假新闻识别准确率
Detecting Fake News on Social Media: A Novel Reliability Aware Machine-Crowd Hybrid Intelligence-Based Method
- 用贝叶斯深度学习捕捉机器判断的可信度
- 基于项目反应理论聚合用户反馈,评估人群判断可靠性
- 创新融合机制输出带可信度的预测结果,适合平台方使用
社交媒体上的假新闻对社会系统构成严重威胁,亟需先进检测方法。现有方法分为基于机器智能、群体智能和混合智能三类,其中混合智能表现最佳,但未考虑判断可靠性问题。为此,本文提出一种新型可靠性感知混合智能(RAHI)方法,包含三个模块:第一模块采用贝叶斯深度学习模型捕获机器智能中的固有可靠性;第二模块基于项目反应理论(IRT)的用户响应聚合机制,评估群体智能中的可靠性;第三模块引入新的分布融合机制,将机器与群体智能所得分布作为输入,输出融合后的分布,提供带有可靠性信息的预测。在微博数据集上的实验验证了该方法的优势。本研究为假新闻检测领域贡献了新方法,代码已公开于https://github.com/Kangwei-g/RAHI。研究对互联网用户、平台管理者及政府均有实际应用价值。
原文摘要 · Abstract (English)
Fake news on social media platforms poses a significant threat to societal systems, underscoring the urgent need for advanced detection methods. The existing detection methods can be divided into machine intelligence-based, crowd intelligence-based, and hybrid intelligence-based methods. Among them, hybrid intelligence-based methods achieve the best performance but fail to consider the reliability issue in detection. In light of this, we propose a novel Reliability Aware Hybrid Intelligence (RAHI) method for fake news detection. Our method comprises three integral modules. The first module employs a Bayesian deep learning model to capture the inherent reliability within machine intelligence. The second module uses an Item Response Theory (IRT)-based user response aggregation to account for the reliability in crowd intelligence. The third module introduces a new distribution fusion mechanism, which takes the distributions derived from both machine and crowd intelligence as input, and outputs a fused distribution that provides predictions along with the associated reliability. The experiments on the Weibo dataset demonstrate the advantages of our method. This study contributes to the research field with a novel RAHI-based method, and the code is shared at https://github.com/Kangwei-g/RAHI. This study has practical implications for three key stakeholders: internet users, online platform managers, and the government.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。