arXiv:2604.06285cs.CRcs.AI2026-04中稿 · ICLR被引 1

用双曲几何检测并净化有害提示,提升视觉语言模型安全性

Harnessing Hyperbolic Geometry for Harmful Prompt Detection and Sanitization

  • 利用双曲空间结构建模正常提示,识别异常有害内容
  • 检测准确率优于现有方法,在多种攻击下保持稳定
  • 可解释性修改关键词,既去害又保留原意,适合安全防护场景

视觉语言模型(VLMs)通过在共享嵌入空间中对齐文本与视觉信息,广泛应用于图像生成、描述和检索等任务。然而,其灵活性也使其易受恶意提示攻击,导致生成不安全内容,带来严重安全风险。现有防御方法或依赖易被绕过的黑名单过滤,或依赖计算量大且脆弱的分类器系统。本文提出两个互补组件:双曲提示探测(HyPE)与双曲提示净化(HyPS)。HyPE是一种轻量级异常检测器,利用双曲空间的结构化几何特性建模正常提示,将有害提示识别为异常点。HyPS在此基础上,采用可解释归因方法定位并选择性修改有害词汇,消除不当意图的同时保留原始语义。在多个数据集和对抗场景下的大量实验表明,该框架在检测准确率与鲁棒性方面均显著优于现有防御方案。HyPE与HyPS共同提供一种高效、可解释且抗攻击的VLM安全防护新范式。

原文摘要 · Abstract (English)

Vision-Language Models (VLMs) have become essential for tasks such as image synthesis, captioning, and retrieval by aligning textual and visual information in a shared embedding space. Yet, this flexibility also makes them vulnerable to malicious prompts designed to produce unsafe content, raising critical safety concerns. Existing defenses either rely on blacklist filters, which are easily circumvented, or on heavy classifier-based systems, both of which are costly and fragile under embedding-level attacks. We address these challenges with two complementary components: Hyperbolic Prompt Espial (HyPE) and Hyperbolic Prompt Sanitization (HyPS). HyPE is a lightweight anomaly detector that leverages the structured geometry of hyperbolic space to model benign prompts and detect harmful ones as outliers. HyPS builds on this detection by applying explainable attribution methods to identify and selectively modify harmful words, neutralizing unsafe intent while preserving the original semantics of user prompts. Through extensive experiments across multiple datasets and adversarial scenarios, we prove that our framework consistently outperforms prior defenses in both detection accuracy and robustness. Together, HyPE and HyPS offer an efficient, interpretable, and resilient approach to safeguarding VLMs against malicious prompt misuse.

视觉语言模型安全防御双曲几何提示净化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。