用内容特征评估网络攻防风险,让大模型拒绝请求更合理
A Content-Based Framework for Cybersecurity Refusal Decisions in Large Language Models
- 基于请求的技术实质而非意图判断攻防风险
- 五维指标量化攻击贡献、防御收益等关键因素
- 适合安全团队定制可控的拒绝策略
大型语言模型及其代理在网络安全任务中应用日益广泛,而这些任务具有双重用途。现有拒绝机制多依赖宽泛的主题禁令或以攻击为导向的分类体系,导致决策不一致、过度限制合法防御行为,且易受混淆或请求拆分干扰。本文提出一种基于内容的拒绝框架,明确权衡攻击风险与防御收益,而非仅依据意图或攻击分类。该框架从五个维度刻画请求:攻击行动贡献度、攻击风险、技术复杂度、防御收益和合法用户预期频率,均基于请求的技术实质。实验表明,该方法可解决前沿模型行为中的不一致性,并使组织构建可调、风险感知的拒绝策略。
原文摘要 · Abstract (English)
Large language models and LLM-based agents are increasingly used for cybersecurity tasks that are inherently dual-use. Existing approaches to refusal, spanning academic policy frameworks and commercially deployed systems, often rely on broad topic-based bans or offensive-focused taxonomies. As a result, they can yield inconsistent decisions, over-restrict legitimate defenders, and behave brittlely under obfuscation or request segmentation. We argue that effective refusal requires explicitly modeling the trade-off between offensive risk and defensive benefit, rather than relying solely on intent or offensive classification. In this paper, we introduce a content-based framework for designing and auditing cyber refusal policies that makes offense-defense tradeoffs explicit. The framework characterizes requests along five dimensions: Offensive Action Contribution, Offensive Risk, Technical Complexity, Defensive Benefit, and Expected Frequency for Legitimate Users, grounded in the technical substance of the request rather than stated intent. We demonstrate that this content-grounded approach resolves inconsistencies in current frontier model behavior and allows organizations to construct tunable, risk-aware refusal policies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。