用模型编辑技术可精准引导智能体向善或作恶,揭示AI伦理控制的双刃剑效应。
Model Editing as a Double-Edged Sword: Steering Agent Ethical Behavior Toward Beneficence or Harm
- 将行为引导视为模型编辑任务,实现对智能体伦理行为的精准修改。
- 在多层级心理道德基准上验证,编辑可实现局部调整与全局道德转向。
- 适用于前沿大模型,既可用于提升伦理安全,也暴露被恶意利用的风险。
基于大语言模型(LLMs)的智能体在各类任务中表现出强大能力,但在高风险领域部署时存在显著安全与伦理风险。这些智能体的不道德行为可能引发真实世界中的身体伤害与财务损失。为高效引导智能体的伦理行为,本文将行为引导建模为模型编辑任务,称为行为编辑(Behavior Editing)。模型编辑是一种新兴研究方向,可在保持模型整体能力的同时实现精确高效的修改。为系统研究与评估该方法,我们提出BehaviorBench——一个基于心理学道德理论的多层级基准,支持在多种情境下对智能体行为进行评估与编辑,每一层级引入更复杂和模糊的情境。我们首先证明行为编辑可在特定情境中动态引导智能体向目标行为靠拢;此外,该方法不仅能实现情境特异的局部调整,还能引发智能体全局道德倾向的广泛转变。实验表明,行为编辑既可用于促进伦理与利他行为,也可诱导有害或恶意行为。通过对前沿大模型构建的智能体进行广泛评估,BehaviorBench验证了行为编辑在多种模型与情境下的有效性。研究结果揭示了一种新的智能体行为引导范式,凸显了行为编辑的潜力与风险。
原文摘要 · Abstract (English)
Agents based on Large Language Models (LLMs) have demonstrated strong capabilities across a wide range of tasks. However, deploying LLM-based agents in high-stakes domains comes with significant safety and ethical risks. Unethical behavior by these agents can directly result in serious real-world consequences, including physical harm and financial loss. To efficiently steer the ethical behavior of agents, we frame agent behavior steering as a model editing task, which we term Behavior Editing. Model editing is an emerging area of research that enables precise and efficient modifications to LLMs while preserving their overall capabilities. To systematically study and evaluate this approach, we introduce BehaviorBench, a multi-tier benchmark grounded in psychological moral theories. This benchmark supports both the evaluation and editing of agent behaviors across a variety of scenarios, with each tier introducing more complex and ambiguous scenarios. We first demonstrate that Behavior Editing can dynamically steer agents toward the target behavior within specific scenarios. Moreover, Behavior Editing enables not only scenario-specific local adjustments but also more extensive shifts in an agent's global moral alignment. We demonstrate that Behavior Editing can be used to promote ethical and benevolent behavior or, conversely, to induce harmful or malicious behavior. Through extensive evaluations of agents built on frontier LLMs, BehaviorBench validates the effectiveness of behavior editing across a wide range of models and scenarios. Our findings offer key insights into a new paradigm for steering agent behavior, highlighting both the promise and perils of Behavior Editing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。