arXiv:2509.06807cs.CL2025-09被引 2

让大模型既安全又实用,不靠妥协

MoGU V2: Toward a Higher Pareto Frontier Between Model Usability and Security

  • 动态路由分配权重,平衡安全与可用性
  • 在多种模型上实现稳定性能提升
  • 适合实际部署,尤其资源受限场景

随着大语言模型深度融入人类生活,其安全性成为关键问题,尤其是面对恶意指令时保持无害回应的能力。尽管已有大量方法提升了模型安全性,但往往导致过于保守、拒绝式响应,损害实际可用性。如何突破这一权衡,推动安全与可用性的帕累托前沿?为此,我们提出MoGU框架,通过感知隐藏状态动态分配权重,平衡安全优化与可用性优化版本的贡献。然而原版存在参数冗余和性能瓶颈。为此,我们进一步提出改进版MoGU_v2:仅在编码可区分安全特征的层中嵌入路由模块,并在路由优化时激活主干模块,实现双向自适应。MoGU_V2在主流大模型、资源受限的本地化模型及注重可解释性的推理模型上均表现出强适应性和稳定提升。即使在指令微调引入风险的情况下,也可通过简单数据混合策略快速恢复安全性能,且不影响任务表现提升。这些成果表明,MoGU_V2是应对真实场景中安全风险的鲁棒且通用的解决方案。

原文摘要 · Abstract (English)

As Large Language Models (LLMs) increasingly permeate human life, their security has emerged as a critical concern, particularly their ability to maintain harmless responses to malicious instructions. Although extensive methods have improved LLMs' security, they often lead to conservative, rejection-oriented responses that compromise practical usability. This presents a key challenge: how to advance the Pareto frontier between LLMs' usability and security, rather than necessitate a trade-off between them. To address this, we propose the MoGU framework, in which the intra-layer router dynamically allocates weights by sensing hidden states, thereby balancing the contributions of security-optimized and usability-optimized variants. Despite its initial potential, the MoGU framework faces limitations such as parameter redundancy and performance bottlenecks. To overcome these, we further propose an improved MoGU_v2 framework that establishes a tighter coupling between the routers and hidden states. In MoGU_v2, routers are embedded only in layers encoding highly classifiable security features, and backbone modules are activated during router optimization to enable bidirectional adaptation. MoGU_V2 exhibits strong adaptability and stable improvements across various series of LLMs, including mainstream LLMs serving as brains in various applications, on-device LLMs optimized for resource-constrained scenarios, and reasoning LLMs tailored for user interpretability. Meanwhile, even facing risks introduced by Instruction Fine-tuning, MoGU_v2 can easily restore security without compromising the task performance gains via a simple data-mix strategy. These comprehensive improvements highlight MoGU_V2 as a robust and versatile solution for mitigating security risks in real-world applications.

大模型安全模型优化实用性鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。