arXiv:2510.18918cs.CLcs.AI2025-10中稿 · publication in the…被引 5

用轻量大模型+可解释性技术,高效精准识别网络假消息

Misinformation Detection using Large Language Models with Explainability

  • 分步微调轻量模型,先固定主干训练分类头
  • DistilBERT精度接近RoBERTa,计算量减少超50%
  • 融合LIME和SHAP提供词级与全局解释,透明可信

在线平台中虚假信息的快速传播破坏了公众信任并阻碍理性决策。本文提出一种可解释且计算高效的假消息检测方法,基于Transformer预训练语言模型(PLMs)实现。通过两阶段优化策略:首先冻结主干网络仅训练分类头;随后逐层解冻并应用层间学习率衰减。在真实数据集COVID Fake News和FakeNewsNet GossipCop上,采用统一的预处理与分层划分协议进行测试。为保障透明性,引入局部可解释模型无关解释(LIME)生成词级理由,以及全局特征归因的SHapley加法解释(SHAP)。实验表明,尽管计算资源显著降低,DistilBERT的准确率仍与RoBERTa相当。本工作贡献在于:(1)定量验证轻量级PLM可在不牺牲性能前提下大幅降低计算开销;(2)构建兼具性能与可解释性的端到端框架,可获取忠实的局部与全局推理依据。结果表明,结合合理微调与可解释技术的PLMs,能构成可扩展、可信的假消息检测体系。

原文摘要 · Abstract (English)

The rapid spread of misinformation on online platforms undermines trust among individuals and hinders informed decision making. This paper shows an explainable and computationally efficient pipeline to detect misinformation using transformer-based pretrained language models (PLMs). We optimize both RoBERTa and DistilBERT using a two-step strategy: first, we freeze the backbone and train only the classification head; then, we progressively unfreeze the backbone layers while applying layer-wise learning rate decay. On two real-world benchmark datasets, COVID Fake News and FakeNewsNet GossipCop, we test the proposed approach with a unified protocol of preprocessing and stratified splits. To ensure transparency, we integrate the Local Interpretable Model-Agnostic Explanations (LIME) at the token level to present token-level rationales and SHapley Additive exPlanations (SHAP) at the global feature attribution level. It demonstrates that DistilBERT achieves accuracy comparable to RoBERTa while requiring significantly less computational resources. This work makes two key contributions: (1) it quantitatively shows that a lightweight PLM can maintain task performance while substantially reducing computational cost, and (2) it presents an explainable pipeline that retrieves faithful local and global justifications without compromising performance. The results suggest that PLMs combined with principled fine-tuning and interpretability can be an effective framework for scalable, trustworthy misinformation detection.

假消息检测可解释性轻量模型大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。