通过分层选择提升假新闻检测模型多样性,效果优于现有方法。
HSFN: Hierarchical Selection for Fake News Detection building Heterogeneous Ensemble
- 基于分层聚类自动筛选具有差异性的分类器组合
- 在6个数据集上2个达最高准确率,整体表现更稳健
- 适合需要高鲁棒性假新闻检测的系统设计者
心理偏见(如确认偏误)使人们极易相信并传播社交媒体上的假新闻,对公共卫生和政治等领域造成重大影响。基于机器学习的事实核查系统被广泛研究,其中集成方法通过融合多个分类器提升鲁棒性。然而其性能高度依赖于分类器的多样性——选择真正异质的模型仍是关键挑战,尤其当模型倾向于学习冗余模式时。本文提出一种新型自动分类器选择方法HSFN,优先考虑多样性并兼顾性能。该方法首先计算分类器间的成对多样性,再通过分层聚类将它们组织为不同粒度的组;随后逐层选取每组中最具内在多样性的分类器池,最终选出最多样化的池用于构建集成。选择过程引入反映分类器性能的评估指标,确保集成具备良好泛化能力。我们在6个不同应用领域、含不同类别数的数据集上,使用40个异构分类器进行实验,与肘部法则及先进基线对比。结果表明,本方法在6个数据集中有2个达到最高准确率,整体表现优异。项目代码已公开:https://github.com/SaraBCoutinho/HSFN。
原文摘要 · Abstract (English)
Psychological biases, such as confirmation bias, make individuals particularly vulnerable to believing and spreading fake news on social media, leading to significant consequences in domains such as public health and politics. Machine learning-based fact-checking systems have been widely studied to mitigate this problem. Among them, ensemble methods are particularly effective in combining multiple classifiers to improve robustness. However, their performance heavily depends on the diversity of the constituent classifiers-selecting genuinely diverse models remains a key challenge, especially when models tend to learn redundant patterns. In this work, we propose a novel automatic classifier selection approach that prioritizes diversity, also extended by performance. The method first computes pairwise diversity between classifiers and applies hierarchical clustering to organize them into groups at different levels of granularity. A HierarchySelect then explores these hierarchical levels to select one pool of classifiers per level, each representing a distinct intra-pool diversity. The most diverse pool is identified and selected for ensemble construction from these. The selection process incorporates an evaluation metric reflecting each classifiers's performance to ensure the ensemble also generalises well. We conduct experiments with 40 heterogeneous classifiers across six datasets from different application domains and with varying numbers of classes. Our method is compared against the Elbow heuristic and state-of-the-art baselines. Results show that our approach achieves the highest accuracy on two of six datasets. The implementation details are available on the project's repository: https://github.com/SaraBCoutinho/HSFN .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。