arXiv:2609.08200cs.LG2026-09

通过子空间交互定位文本异常词元,提升检测精度与可解释性。

SIM: Subspace Interaction-based Method for Token-Level Text Anomaly Detection

论文配图:SIM: Subspace Interaction-based Method for Token-Level Text Anomaly Detection
图 1 · 摘自论文原文
  • 将高维词元嵌入分解为多个低维子空间,增强局部异常信号。
  • 生成硬伪异常词元模拟细微异常,缓解预训练模型的平滑效应。
  • 采用概率边界损失标准化得分,适合安全敏感场景的异常检测。

词元级文本异常检测作为新兴方向,突破了粗粒度文档级检测的局限,能够精确定位文本中的异常词元,在垃圾信息过滤、虚假新闻识别等实际应用中具有重要意义。然而,现有方法仍依赖全局距离计算评分,导致局部异常信号被大量冗余正常特征维度稀释。同时,预训练语言模型固有的语义平滑效应进一步削弱了其在词元级异常检测中的表现。为此,本文提出一种基于子空间交互的词元级异常检测方法(SIM)。SIM通过将高维词元嵌入分解为多个低维子空间,实现异常信号的局部放大;设计硬伪异常生成模块,构造伪异常词元以模拟被语义平滑掩盖的细微异常;引入概率边界损失,将异常得分标准化为统计距离,强制异常实例显著偏离正常分布中心。在多个基准数据集上的实验验证了SIM的有效性,展现了卓越的效率、鲁棒性与可解释性。源代码已公开:https://github.com/yankehan/SIM-TAD。

原文摘要 · Abstract (English)

Token-level text anomaly detection, as an emerging trend of text anomaly detection, moves beyond coarse-grained document-level detection by localizing anomalous tokens within text. By providing fine-grained abnormality prediction, token-level text anomaly detection plays a critical role in various real-world applications, such as spam filtering and fake news detection. However, existing methods still rely on the global distance calculation for scoring, during which the local anomaly signals are severely diluted by numerous redundant normal feature dimensions. Moreover, pre-trained language models used in these methods inevitably smooth out surface anomalies, further limiting their effectiveness in token-level anomaly detection. To address these limitations, we propose a Subspace Interaction-based Method (SIM for short) for token-level text anomaly detection. To prevent local signal dilution, SIM adopts a subspace interaction-based anomaly detector, which decouples high-dimensional token embeddings into multiple low-dimensional ones, amplifying localized anomaly signals hidden within specific dimensions. To counteract the over-smoothing effect, we design a hard pseudo-anomaly generation module to construct pseudo-anomalous tokens, simulating the subtle anomalies obscured by semantic smoothing. Also, a probabilistic boundary loss is developed to standardize anomaly scores into statistical distances, effectively enforcing anomalous instances to deviate significantly from the normal distribution center. Extensive experiments on multiple benchmark datasets verify the effectiveness of SIM and demonstrate its remarkable efficiency, robustness, and interpretability. The source code is available at: https://github.com/yankehan/SIM-TAD.

异常检测文本分析子空间可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。