arXiv:2507.05939cs.CLcs.MM2025-07中稿 · ACM MM 2025被引 3

提出新方法应对社交媒体谣言持续演化问题

Remember Past, Anticipate Future: Learning Continual Multimodal Misinformation Detectors

  • 用专家混合结构分离事件参数,防止旧知识遗忘
  • 通过连续时间模型预判未来环境变化,提升泛化能力
  • 在多个基准上显著优于现有检测与持续学习方法

当前,多模态虚假信息在社交媒体广泛传播,造成严重负面影响。为控制其扩散,多模态虚假信息检测(MMD)成为研究热点。以往方法依赖离线数据训练,但在真实场景中,新事件不断涌现,导致模型迅速过时。为此,需在在线数据流中持续训练,形成新兴任务——持续多模态虚假信息检测(Continual MMD)。然而该任务面临两大挑战:一是新数据训练导致旧知识遗忘;二是社会环境动态演变影响未来泛化能力。为此,本文提出DAEDCMD方法,通过基于狄利克雷过程的专家混合结构隔离事件特定参数以保留过去知识,并构建连续时间动力学模型以预测未来环境分布。大量实验表明,该方法在六种MMD基线和三种持续学习方法上均显著领先。

原文摘要 · Abstract (English)

Nowadays, misinformation articles, especially multimodal ones, are widely spread on social media platforms and cause serious negative effects. To control their propagation, Multimodal Misinformation Detection (MMD) becomes an active topic in the community to automatically identify misinformation. Previous MMD methods focus on supervising detectors by collecting offline data. However, in real-world scenarios, new events always continually emerge, making MMD models trained on offline data consistently outdated and ineffective. To address this issue, training MMD models under online data streams is an alternative, inducing an emerging task named continual MMD. Unfortunately, it is hindered by two major challenges. First, training on new data consistently decreases the detection performance on past data, named past knowledge forgetting. Second, the social environment constantly evolves over time, affecting the generalization on future data. To alleviate these challenges, we propose to remember past knowledge by isolating interference between event-specific parameters with a Dirichlet process-based mixture-of-expert structure, and anticipate future environmental distributions by learning a continuous-time dynamics model. Accordingly, we induce a new continual MMD method DAEDCMD. Extensive experiments demonstrate that DAEDCMD can consistently and significantly outperform the compared methods, including six MMD baselines and three continual learning methods.

虚假信息检测持续学习多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。