不重训模型,用双代理框架提升多模态大模型的安全性。
ReFrame: Evidence-Guided Test-Time Safety Alignment in Multimodal Large Language Models

- 双代理协作重构输入:生成风险与效用证据,转为安全提示和图像路由
- 在多个模型上实现越狱防御率提升,同时减少过度拒绝现象
- 适用于闭源模型,无需访问内部参数或重新训练
多模态大语言模型虽拓展了能力边界,但安全对齐愈发困难。现有方法多依赖重训练或内部状态分析,难以应用于已部署的闭源模型,推动测试时安全对齐的需求。我们分析该场景,发现效用主导与推理惯性是两大障碍,导致模型忽略潜在风险或跟随恶意推理路径。为此提出ReFrame:一个无训练的多模态输入重构框架,由两个代理共享轻量本地部署的MLLM完成:证据生成代理构建互补的风险与效用证据;重写与路由代理将其转化为安全代理提示和图像路由决策,再调用下游MLLM,不修改模型也不访问其内部信息。在多个MLLM和基准上的实验表明,ReFrame在提升越狱防御、增强安全意识的同时,有效缓解过度敏感问题,并保持多模态任务性能。
原文摘要 · Abstract (English)
While multimodal large language models (MLLMs) extend model capabilities beyond text, they also make safety alignment increasingly challenging. Multimodal safety alignment methods must address cross-modal jailbreaks, safety-awareness failures, and over-sensitive refusals. However, existing methods often rely on retraining or internal-state inspection, limiting their applicability to deployed closed-source MLLMs and motivating test-time safety alignment. We analyze this setting and identify two key obstacles, utility dominance and reasoning inertia, which cause models to overlook latent risks or follow malicious reasoning trajectories. Guided by these insights, we propose ReFrame, a training-free multimodal input reframing framework where two agents share a lightweight locally deployed MLLM: the evidence-generation agent constructs complementary risk and utility evidence, and the rewrite-and-routing agent converts it into a safe proxy prompt and image-routing decision before calling the downstream MLLM, without modifying it or accessing its internal information. Experiments across multiple MLLMs and benchmarks show that ReFrame improves jailbreak defense, safety awareness, and oversensitivity reduction while preserving multimodal utility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。