arXiv:2510.08630cs.CL2025-10被引 5

提出可解释的仇恨梗图检测方法,提升准确率与可解释性。

ExPO-HM: Learning to Explain-then-Detect for Hateful Meme Detection

  • 先生成解释再判断,模仿人工标注流程优化推理
  • 在3个数据集上比GRPO和DPO基准提升15%~17%的F1值
  • 适合需要可解释性审核的平台内容安全团队使用

仇恨梗图已成为网络欺凌的严峻挑战,推动自动化检测系统的发展。以往方法多采用直接检测,仅输出二分类结果,缺乏真实审核所需的上下文与解释。近期基于链式思维提示或视觉语言模型代理的解释-检测方法表现仍不如简单微调基线,甚至先进后训练方法如GRPO也未能缩小差距。我们分析发现两大问题:模型未充分推测目标对象与攻击类型等关键政策线索;二元奖励信号不足以引导有效推理。为此,我们提出ExPO-HM(解释-检测策略优化),受人类标注者训练与评估流程启发,结合SFT预热、带课程学习的GRPO,以及条件决策熵(CDE)作为推理质量的度量与奖励。在三个仇恨梗图基准上,ExPO-HM在二分类、细粒度分类与推理质量上均达当前最优,相较GRPO与DPO基线分别提升最高15%与17%的F1值。该方法将仇恨梗图检测从简单二元报警推进至解释驱动的可解释检测,为内容审核提供精准、可解释且可操作的支持。代码已开源。

原文摘要 · Abstract (English)

Hateful memes have emerged as a particularly challenging form of online abuse, motivating the development of automated detection systems. Most prior approaches rely on direct detection, producing only binary predictions. Such models fail to provide the context and explanations that real-world moderation requires. Recent Explain-then-Detect approaches, using Chain-of-Thought prompting or LMM agents, perform worse than simple SFT baselines, and even advanced post-training methods such as GRPO fail to close the gap. Our analysis identifies two key issues of such systems: important policy-relevant cues such as targets and attack types are not hypothesized by the model as a likely explanation; and the binary reward signal is insufficient to guide reasoning. To address these challenges, we propose ExPO-HM (Explain-then-Detect Policy Optimization for Hateful Memes), inspired by the training and evaluation process of human annotators. ExPO-HM combines SFT warmup, GRPO with curriculum learning, and Conditional Decision Entropy (CDE) as both metric and reward for reasoning quality. Across three hateful meme benchmarks, ExPO-HM achieves state-of-the-art performance on binary detection, fine-grained classification, and reasoning quality, with up to 15\% and 17\% F1 improvement over the GRPO and DPO baselines, respectively. By moving hateful meme detection from simple binary alarms to explanation-driven detection, ExPO-HM provides accurate, interpretable, and actionable moderation support. Code available at https://github.com/JingbiaoMei/ExPO-HM

仇恨内容检测可解释AI多模态策略优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。