arXiv:2602.00132cs.CV2026-02AAAI被引 2

针对恶意视频形态变化导致检测失效的问题,提出新方法实现推理时自适应调整。

Shedding the Facades, Connecting the Domains: Detecting Shifting Multimodal Hate Video with Test-Time Adaptation

  • 利用仇恨内容背后的稳定特征(如性别、种族)作为跨域连接桥梁。
  • 在测试时通过聚类对齐与多样性正则化,提升模型对语义漂移的适应能力。
  • 适合应对网络仇恨内容隐蔽演化场景,尤其适用于实时视频安全监控。

仇恨视频检测(HVD)对在线生态至关重要。现有方法假设训练数据(源域)与推理数据(目标域)分布一致,但仇恨内容常以不规则、模糊的形式演变以逃避审查,导致显著的语义漂移,使已有模型失效。测试时自适应(TTA)可在推理阶段调整模型以缩小跨域差距,但传统TTA仅适用于轻微分布偏移,在严重语义漂移的HVD任务中表现不佳。为此,我们提出首个专为HVD设计的TTA框架SCANNER。基于核心洞察——尽管仇恨表现形式不断演变,其底层核心(如针对性别、种族等特征)仍保持相对不变——我们利用这些稳定核心作为源域与目标域间的桥梁。具体而言,SCANNER通过一种基于中心点引导的对齐机制,从动态演化的内容中揭示出稳定的语义核心。为缓解对齐过程中弱相关异常样本的影响,引入样本级自适应中心点对齐策略,增强先验稳定性。此外,为防止聚类内语义坍塌,提出簇内多样性正则化,促进聚类内部的语义丰富性。实验表明,SCANNER优于所有基线,平均在宏F1上提升4.69%。

原文摘要 · Abstract (English)

Hate Video Detection (HVD) is crucial for online ecosystems. Existing methods assume identical distributions between training (source) and inference (target) data. However, hateful content often evolves into irregular and ambiguous forms to evade censorship, resulting in substantial semantic drift and rendering previously trained models ineffective. Test-Time Adaptation (TTA) offers a solution by adapting models during inference to narrow the cross-domain gap, while conventional TTA methods target mild distribution shifts and struggle with the severe semantic drift in HVD. To tackle these challenges, we propose SCANNER, the first TTA framework tailored for HVD. Motivated by the insight that, despite the evolving nature of hateful manifestations, their underlying cores remain largely invariant (i.e., targeting is still based on characteristics like gender, race, etc), we leverage these stable cores as a bridge to connect the source and target domains. Specifically, SCANNER initially reveals the stable cores from the ambiguous layout in evolving hateful content via a principled centroid-guided alignment mechanism. To alleviate the impact of outlier-like samples that are weakly correlated with centroids during the alignment process, SCANNER enhances the prior by incorporating a sample-level adaptive centroid alignment strategy, promoting more stable adaptation. Furthermore, to mitigate semantic collapse from overly uniform outputs within clusters, SCANNER introduces an intra-cluster diversity regularization that encourages the cluster-wise semantic richness. Experiments show that SCANNER outperforms all baselines, with an average gain of 4.69% in Macro-F1 over the best.

仇恨检测测试自适应多模态视频安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。