用图模型发现多模态数据中隐藏的毒性,让恶意内容无处遁形。
Unveiling Covert Toxicity in Multimodal Data via Toxicity Association Graphs: A Graph-Based Metric and Interpretable Detection Framework
- 构建毒性关联图,捕捉跨模态隐性有害关联
- 提出可量化的隐蔽毒性度量MTC,最高提升37%检测准确率
- 首次提供可解释的检测结果,适合安全审查与合规场景
多模态数据中的毒性检测仍具挑战,因有害含义常潜伏于看似无害的单一模态中,仅在多模态融合与语义关联激活时显现。为此,我们提出基于毒性关联图(TAGs)的新检测框架,系统建模无害实体与潜在毒性含义之间的语义关联。借助TAGs,我们首次定义了可量化隐蔽毒性的指标——多模态隐蔽毒性度量(MTC),用于衡量毒性表达的隐藏程度。结合该指标与检测框架,本方法可精准识别隐蔽毒性,同时保持决策过程完全可解释,显著提升多模态毒性检测的透明性。为验证方法,我们构建了首个专为高隐蔽性毒性实例设计的基准数据集——Covert Toxic Dataset,包含细微跨模态关联,作为严谨评估平台。大量实验表明,本方法在低与高隐蔽性毒性场景下均优于现有方法,且输出清晰、可解释、可审计的检测结果。整体贡献推动了可解释多模态毒性检测的前沿发展,并为未来上下文感知、可解释方法奠定基础。内容警示:本文含可能令人不适的多模态毒性示例,建议读者谨慎阅读。
原文摘要 · Abstract (English)
Detecting toxicity in multimodal data remains a significant challenge, as harmful meanings often lurk beneath seemingly benign individual modalities: only emerging when modalities are combined and semantic associations are activated. To address this, we propose a novel detection framework based on Toxicity Association Graphs (TAGs), which systematically model semantic associations between innocuous entities and latent toxic implications. Leveraging TAGs, we introduce the first quantifiable metric for hidden toxicity, the Multimodal Toxicity Covertness (MTC), which measures the degree of concealment in toxic multimodal expressions. By integrating our detection framework with the MTC metric, our approach enables precise identification of covert toxicity while preserving full interpretability of the decision-making process, significantly enhancing transparency in multimodal toxicity detection. To validate our method, we construct the Covert Toxic Dataset, the first benchmark specifically designed to capture high-covertness toxic multimodal instances. This dataset encodes nuanced cross-modal associations and serves as a rigorous testbed for evaluating both the proposed metric and detection framework. Extensive experiments demonstrate that our approach outperforms existing methods across both low- and high-covertness toxicity regimes, while delivering clear, interpretable, and auditable detection outcomes. Together, our contributions advance the state of the art in explainable multimodal toxicity detection and lay the foundation for future context-aware and interpretable approaches. Content Warning: This paper contains examples of toxic multimodal content that may be offensive or disturbing to some readers. Reader discretion is advised.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。