arXiv:2504.07687cs.CVcs.MM2025-04被引 5

构建媒体发布假新闻视频数据集,助力高影响假消息检测

FMNV: A Dataset of Media-Published News Videos for Fake News Detection

  • 聚焦媒体机构发布的假新闻视频,构建全新数据集FMNV
  • 提出双流模型FMNVD,在多模态融合上实现更优检测效果
  • 适合关注虚假信息治理与跨模态分析的研究者使用

新闻媒体,尤其是基于视频的平台,已深度融入日常生活,同时加剧了虚假信息传播的风险。因此,多模态假新闻检测受到广泛关注。然而,现有数据集主要包含用户生成的视频,编辑粗糙且公众参与度有限;而由媒体机构发布的、具有政治或病毒式传播动机的专业伪造视频,对社会危害更大。为填补这一空白,我们构建了FMNV,一个仅包含媒体机构发布新闻视频的新数据集。通过对现有数据集和自建集合的实证分析,我们将假新闻视频分为四类。基于此分类体系,利用大语言模型(LLMs)通过篡改真实媒体新闻视频自动生成欺骗性内容。此外,我们提出FMNVD基线模型,采用双流架构:一途提取3D ResNeXt-101骨干网络的时空运动特征,另一途结合CLIP的静态视觉语义。两路通过注意力机制融合,并引入共注意力模块优化视觉、文本与音频特征,实现有效的多模态聚合。对比实验表明,FMNV在多个基线上具有强泛化能力,而FMNVD展现出卓越的检测性能。本工作为媒体生态系统中高影响力假新闻检测建立了关键基准,推动了跨模态不一致性分析的方法发展。数据集已公开于https://github.com/DennisIW/FMNV。

原文摘要 · Abstract (English)

News media, particularly video-based platforms, have become deeply embed-ded in daily life, concurrently amplifying the risks of misinformation dissem-ination. Consequently, multimodal fake news detection has garnered signifi-cant research attention. However, existing datasets predominantly comprise user-generated videos characterized by crude editing and limited public en-gagement, whereas professionally crafted fake news videos disseminated by media outlets-often politically or virally motivated-pose substantially greater societal harm. To address this gap, we construct FMNV, a novel da-taset exclusively composed of news videos published by media organizations. Through empirical analysis of existing datasets and our curated collection, we categorize fake news videos into four distinct types. Building upon this taxonomy, we employ Large Language Models (LLMs) to automatically generate deceptive content by manipulating authentic media-published news videos. Furthermore, we propose FMNVD, a baseline model featuring a dual-stream architecture that integrates spatio-temporal motion features from a 3D ResNeXt-101 backbone and static visual semantics from CLIP. The two streams are fused via an attention-based mechanism, while co-attention modules refine the visual, textual, and audio features for effective multi-modal aggregation. Comparative experiments demonstrate both the generali-zation capability of FMNV across multiple baselines and the superior detec-tion efficacy of FMNVD. This work establishes critical benchmarks for de-tecting high-impact fake news in media ecosystems while advancing meth-odologies for cross-modal inconsistency analysis. Our dataset is available in https://github.com/DennisIW/FMNV.

假新闻检测多模态分析数据集构建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。