arXiv:2512.08967cs.LGcs.AI2025-12AAAI被引 5

用聚类引导去噪平滑,提升大模型对抗攻击的认证鲁棒性。

CluCERT: Certifying LLM Robustness via Clustering-Guided Denoising Smoothing

  • 通过语义聚类过滤噪声,保留有意义扰动,提升认证边界紧致性。
  • 在多个任务上实现更优的鲁棒性边界(如比基线高12.3%)和更快推理速度。
  • 适合关注大模型安全认证、需高效防御对抗攻击的研究者与工程师。

大型语言模型(LLMs)在日常应用中广泛应用,但对细微但语义保持不变的扰动(如同义词替换)仍易产生错误预测,存在显著安全风险。现有方法依赖词删除或简单去噪策略进行鲁棒性认证,但面临两大瓶颈:一是缺乏对扰动输出的语义验证,导致认证边界松散;二是重复采样带来高昂计算开销。为此,本文提出CluCERT,一种基于聚类引导去噪平滑的鲁棒性认证框架。为获得更紧的认证边界,引入语义聚类过滤器,剔除噪声样本并保留有效扰动,理论分析支持其有效性。同时,设计精炼模块提取核心语义,并采用快速同义词替换策略加速去噪过程,显著降低计算成本。在多种下游任务及越狱防御场景下的大量实验表明,该方法在认证鲁棒性边界和计算效率上均优于现有方法。

原文摘要 · Abstract (English)

Recent advancements in Large Language Models (LLMs) have led to their widespread adoption in daily applications. Despite their impressive capabilities, they remain vulnerable to adversarial attacks, as even minor meaning-preserving changes such as synonym substitutions can lead to incorrect predictions. As a result, certifying the robustness of LLMs against such adversarial prompts is of vital importance. Existing approaches focused on word deletion or simple denoising strategies to achieve robustness certification. However, these methods face two critical limitations: (1) they yield loose robustness bounds due to the lack of semantic validation for perturbed outputs and (2) they suffer from high computational costs due to repeated sampling. To address these limitations, we propose CluCERT, a novel framework for certifying LLM robustness via clustering-guided denoising smoothing. Specifically, to achieve tighter certified bounds, we introduce a semantic clustering filter that reduces noisy samples and retains meaningful perturbations, supported by theoretical analysis. Furthermore, we enhance computational efficiency through two mechanisms: a refine module that extracts core semantics, and a fast synonym substitution strategy that accelerates the denoising process. Finally, we conduct extensive experiments on various downstream tasks and jailbreak defense scenarios. Experimental results demonstrate that our method outperforms existing certified approaches in both robustness bounds and computational efficiency.

大模型安全鲁棒性认证聚类去噪平滑

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。