arXiv:2509.23188cs.CL2025-09被引 4

解决大模型多智能体系统指令冲突下的可靠性问题。

Diagnose, Localize, Align: A Full-Stack Framework for Reliable LLM Multi-Agent Systems under Instruction Conflicts

  • 提出三阶段框架,从诊断到定位再到对齐修复。
  • 在MedQA上提升5.60%的指令层级合规性,无需全模型微调。
  • 适合关注多智能体系统稳定性和可解释性的研究者。

基于大语言模型的多智能体系统在复杂任务中展现出协同推理、工具使用和角色专业化协作的能力。然而,其关键部署仍受制于一种系统性故障:当存在指令冲突(如系统-用户、同级间)时,智能体未能正确优先遵循系统级规则。现有宏观指标(如pass@k)无法揭示此类微观违规行为,也难以提供有效改进方向。本文提出一个全栈式三阶段框架:(1) 诊断——引入上下文感知的角色遵从评分(CRAS),将角色遵从分解为四个可度量维度;(2) 定位——通过注意力漂移分析发现,指令冲突的解决主要依赖中间层注意力头;(3) 对齐——手术式指令层对齐(SAIL),仅在定位出的关键层部署LoRA,并优化基于令牌权重的DPO风格偏好目标,以奖励具有显著注意力贡献的令牌。在多个标准基准与多智能体框架上,该方法在不进行全模型微调的前提下,显著提升了指令层级的合规性(如在AutoGen上的MedQA任务中提升5.60%)。

原文摘要 · Abstract (English)

Large Language Model (LLM)-powered multi-agent systems (MAS) have rapidly advanced collaborative reasoning, tool use, and role-specialized coordination in complex tasks. However, reliability-critical deployment remains hindered by a systemic failure mode: hierarchical compliance under instruction conflicts (system-user, peer-peer), where agents misprioritize system-level rules in the presence of competing demands. Moreover, widely used macro-level metrics (e.g., pass@k) obscure these micro-level violations and offer little actionable guidance for remedy. In this work, we present a full-stack, three-stage framework: (1) Diagnose - Contextualized Role Adherence Score (CRAS), a query-wise, context-aware scoring metric that decomposes role adherence into four measurable dimensions; (2) Localize - attention drift analysis revealing that instruction conflicts are resolved by attention heads that are largely concentrated in middle layers; (3) Align - Surgical Alignment of Instruction Layers (SAIL), which installs LoRA only on the localized focal layers and optimizes a token-weighted DPO-style preference objective that credits tokens by their focal attentional contribution. Across standard benchmarks and MAS frameworks, our surgical approach improves instruction hierarchy compliance (e.g., +5.60% with AutoGen on MedQA) without full-model finetuning.

多智能体指令对齐大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。