arXiv:2502.09097cs.CL2025-02被引 29

用贝叶斯优化与双向循环单元增强Transformer,提升假新闻检测准确率。

A Hybrid Transformer Model for Fake News Detection: Leveraging Bayesian Optimization and Bidirectional Recurrent Unit

  • 融合贝叶斯优化与BiGRU的Transformer模型,提升特征提取能力。
  • 测试集准确率达99.73%,较基础模型提升0.06%。
  • 训练10轮即接近100%准确,适合快速部署的假新闻识别场景。

本文提出一种结合贝叶斯算法与双向门控循环单元(BiGRU)的优化Transformer模型,首次应用于假新闻分类任务。首先采用TF-IDF方法从新闻文本中提取特征并转换为数值表示,以支持后续机器学习任务。设计两组实验:一组仅使用优化后的BiGRU-Transformer,另一组在该基础上引入贝叶斯算法。实验结果表明,仅含BiGRU的Transformer在训练集上达到100%准确率,测试集为99.67%;加入贝叶斯算法后,训练集仍保持100%准确率,测试集提升至99.73%,表明贝叶斯优化使模型准确率提高0.06%。此外,该模型约在第10个训练轮次时收敛至接近100%的准确率,展现出高效且稳定的分类能力。整体而言,该优化模型具备出色的持续学习与检测性能,为信息过载时代打击假新闻传播提供了有力技术手段。

原文摘要 · Abstract (English)

In this paper, we propose an optimized Transformer model that integrates Bayesian algorithms with a Bidirectional Gated Recurrent Unit (BiGRU), and apply it to fake news classification for the first time. First, we employ the TF-IDF method to extract features from news texts and transform them into numeric representations to facilitate subsequent machine learning tasks. Two sets of experiments are then conducted for fake news detection and classification: one using a Transformer model optimized only with BiGRU, and the other incorporating Bayesian algorithms into the BiGRU-based Transformer. Experimental results show that the BiGRU-optimized Transformer achieves 100% accuracy on the training set and 99.67% on the test set, while the addition of the Bayesian algorithm maintains 100% accuracy on the training set and slightly improves test-set accuracy to 99.73%. This indicates that the Bayesian algorithm boosts model accuracy by 0.06%, further enhancing the detection capability for fake news. Moreover, the proposed algorithm converges rapidly at around the 10th training epoch with accuracy nearing 100%, demonstrating both its effectiveness and its fast classification ability. Overall, the optimized Transformer model, enhanced by the Bayesian algorithm and BiGRU, exhibits excellent continuous learning and detection performance, offering a robust technical means to combat the spread of fake news in the current era of information overload.

假新闻检测Transformer贝叶斯优化序列模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。