arXiv:2606.00023cs.CLcs.AI2026-06被引 3

测试语言扩散模型在恶意上下文下的可信度,发现其安全性和公平性会显著下降。

TrustLDM: Benchmarking Trustworthiness in Language Diffusion Models

论文配图:TrustLDM: Benchmarking Trustworthiness in Language Diffusion Models
图 1 · 摘自论文原文
  • 构建专用评测基准TrustLDM,评估模型在多种静态后文上下文下的可信度。
  • 附加恶意后文时,模型对齐能力明显退化,生成内容更易受干扰。
  • 提出自动评估框架TrustLDM-Auto,可系统识别脆弱配置,适合安全研究者使用。

语言扩散模型(LDMs)的快速发展对其自回归对手构成了挑战。然而,其灵活的任意顺序解码策略虽带来快速生成速度,也可能引发新的可信度风险。为深入理解其管道中的潜在威胁,我们提出了针对LDMs的综合性可信度评测基准TrustLDM,评估不同架构在多种静态后文上下文下的安全性、隐私性和公平性。实证结果显示,尽管仅依赖用户提示时LDMs通常表现良好,但当恶意后文附加于掩码响应时,其对齐行为显著退化。我们还发现,较长上下文并不必然导致更强影响,且解码顺序与生成长度均会影响评估结果。最后,我们提出TrustLDM-Auto——一个利用LDM解码灵活性的自动评估框架,系统性地识别出所有被测模型在各维度上的显著可信度弱点。本工作或有助于社区构建更可信的LDMs。代码已公开于https://github.com/PKU-ML/TrustLDM。

原文摘要 · Abstract (English)

The rapid development of Language Diffusion Models (LDMs) challenges the dominant position of auto-regressive competitors in language processing. However, their flexible, any-order decoding strategies not only enable fast decoding speed but also potentially bring new trustworthiness challenges. To better understand the risks behind their pipelines, we introduce a comprehensive trustworthiness benchmark tailored to LDMs (TrustLDM), evaluating safety, privacy, and fairness across different LDM architectures with multiple categories of static post contexts. Our empirical results show that although LDMs generally exhibit strong trustworthiness with only the user prompts, their alignment behavior degrades noticeably when the malicious post contexts are attached to the masked responses. We further observe that longer contexts do not necessarily induce stronger effects, and both decoding order and generation length affect the evaluation outcomes. Finally, we propose TrustLDM-Auto, an automatic evaluation framework that leverages LDM decoding flexibility to systematically identify vulnerable configurations, revealing substantial trustworthiness weaknesses across all evaluated models and dimensions. Our work may potentially help the community build more trustworthy LDMs. Our code is available at https://github.com/PKU-ML/TrustLDM.

语言模型可信度评测扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。