arXiv:2605.25893cs.AI2026-05被引 1

为扩散型大模型设计动态安全监控,根据犹豫程度智能切换检测方式。

$D^2$-Monitor: Dynamic Safety Monitoring for Diffusion LLMs via Hesitation-Aware Routing

论文配图:$D^2$-Monitor: Dynamic Safety Monitoring for Diffusion LLMs via Hesitation-Aware Routing
图 1 · 摘自论文原文
  • 通过分析生成过程中的犹豫信号,判断何时需更精准的检测。
  • 在3个数据集上达到顶尖性能,参数量仅0.85M以下。
  • 适合需要高效高精度安全检测的应用场景。

尽管扩散型大语言模型(D-LLMs)作为自回归模型的替代方案出现,其安全监控仍鲜有研究。与自回归模型不同,D-LLMs通过多步去噪生成文本,中间隐藏表示可能包含安全相关线索,而这些信息在单步监控中无法获取。我们发现,最有效的指示信号是安全犹豫:中间状态反复处于探测器决策边界附近的小范围内。该类犹豫步骤数量可有效预测探测失败,成为样本难度的代理指标。基于此,我们提出 $D^2$-Monitor,一种双层安全监控机制。它采用轻量探测器持续监控,同时估计犹豫程度并执行基础分类;当犹豫水平超过阈值时,激活更强大但计算开销更高的探测器。该动态路由机制在测试时高效分配资源。在WildguardMix、ToxicChat、OpenAI-Moderation共3个数据集上,对4种D-LLMs的评估显示,$D^2$-Monitor以不超过0.85M参数量实现最优效果,相较8个基线展现出最佳有效性与效率平衡。

原文摘要 · Abstract (English)

Despite the emergence of diffusion large language models (D-LLMs) as an alternative to autoregressive large language models (AR-LLMs), safety monitoring for D-LLMs remains largely unexplored. Unlike AR-LLMs, D-LLMs generate text through a multi-step denoising process, exposing intermediate hidden representations that may contain safety-relevant information unavailable in standard single-step monitoring setups. Motivated by the suitability of lightweight probes for always-on monitoring, we analyze which trajectory-level signals best indicate when such probes are likely to struggle. We find that the most informative signal is safety hesitation: intermediate hidden states repeatedly falling within a small margin of the probe's decision boundary. The number of such hesitation steps in D-LLM's trajectory predicts probe failure effectively, providing a proxy of sample difficulty. Building on this analysis, we propose $D^2$-Monitor, a bi-level safety monitor for D-LLMs. $D^2$-Monitor adopts a lightweight probe as an always-on monitor to jointly estimate hesitation and perform base classification. When the hesitation level exceeds a threshold, a more expressive but computationally heavier probe is activated. This dynamic routing mechanism allocates monitoring resources efficiently at test time. Evaluated on 3 datasets (WildguardMix, ToxicChat, OpenAI-Moderation) across 4 D-LLMs, $D^2$-Monitor achieves state-of-the-art performance with a compact parameter footprint ($\leq$ 0.85M parameters), and exhibits the best trade-off between effectiveness and efficiency relative to 8 baselines.

扩散模型安全监控动态路由轻量检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。