主动标注目标域样本,提升跨域假新闻检测准确率。
Adaptation Method for Misinformation Identification
- 设计多专家分类器捕捉文本、图像及跨模态不一致模式。
- 通过不确定性选择策略减少标注量,提升目标域覆盖度。
- 在多个数据集上比现有方法最高提升14.02%,适合低资源场景。
多模态假新闻检测在应对网络虚假信息中至关重要,但现有方法依赖标注数据,在源域与目标域分布差异大时性能显著下降。为此,本文提出 ADOSE 框架,一种主动域适应方法,通过主动标注少量目标域样本提升检测效果。设计多个专家分类器以学习不同模态间的依赖关系:两个单模态分类器捕捉各模态内部知识错误,一个跨模态分类器识别图文语义不一致。为降低目标域标注成本,提出基于最小分歧的不确定性选择器,结合多分类器预测差异与多视角特征多样性评分,筛选最具代表性样本。在多个数据集上的实验表明,ADOSE 相较于现有 ADA 方法性能提升 2.72% 至 14.02%,验证了模型优越性。
原文摘要 · Abstract (English)
Multimodal fake news detection plays a crucial role in combating online misinformation. Unfortunately, effective detection methods rely on annotated labels and encounter significant performance degradation when domain shifts exist between training (source) and test (target) data. To address the problems, we propose ADOSE, an Active Domain Adaptation (ADA) framework for multimodal fake news detection which actively annotates a small subset of target samples to improve detection performance. To identify various deceptive patterns in cross-domain settings, we design multiple expert classifiers to learn dependencies across different modalities. These classifiers specifically target the distinct deception patterns exhibited in fake news, where two unimodal classifiers capture knowledge errors within individual modalities while one cross-modal classifier identifies semantic inconsistencies between text and images. To reduce annotation costs from the target domain, we propose a least-disagree uncertainty selector with a diversity calculator for selecting the most informative samples. The selector leverages prediction disagreement before and after perturbations by multiple classifiers as an indicator of uncertain samples, whose deceptive patterns deviate most from source domains. It further incorporates diversity scores derived from multi-view features to ensure the chosen samples achieve maximal coverage of target domain features. The extensive experiments on multiple datasets show that ADOSE outperforms existing ADA methods by 2.72\% $\sim$ 14.02\%, indicating the superiority of our model.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。