为汽车舱内多智能体系统设计了更安全的故障归因框架
CockpitHAT: Dependency-Graph-Driven Hierarchical Attribution for Embodied Multi-Agent Cockpits

- 用依赖图距离替代位置窗口,捕捉任务间真实依赖关系
- 融合对话、车辆状态等多通道证据,准确率提升至78.3%
- 专为高风险场景设计,适合自动驾驶等安全敏感应用
大语言模型多智能体系统存在正确性坍塌问题:任务级准确率高,但过程级故障严重。在汽车舱等安全关键场景中,语法正确的指令可能引发危险物理操作。现有归因方法仅依赖文本轨迹,忽略依赖结构、多通道证据和安全评估。本文提出CockpitHAT,通过交互有向无环图(DAG)的依赖距离阈值替代位置窗口,利用具身适配器整合对话、车辆状态、环境与记忆多通道证据,并在置信加权分析共识中引入安全增益机制以应对高风险失败。我们还发布了CockpitBench基准,包含212条标注故障轨迹,涵盖四种通道,由三名专家共识标注ISO 26262 ASIL严重等级。在公开的Who&When基准上,CockpitHAT在手工构造数据集上实现77.9%的智能体级准确率与37.8%的步骤精确率,在算法生成数据集上达86.5%与46.0%,较纯文本方法SOTA ECHO最高提升17.6/16.7点。在CockpitBench上,分别取得78.3%与38.2%的准确率。结果表明,依赖感知、多通道、风险校准的归因是实现真实世界具身多智能体系统可靠故障诊断的有效范式。
原文摘要 · Abstract (English)
LLM multi-agent systems suffer from Correctness Collapse, where high task-level accuracy conceals severe process-level failures. This is especially hazardous in safety-critical embodied settings such as automotive cockpits, where lexically correct utterances may trigger dangerous physical operations. Existing attribution methods rely on text traces alone, missing dependency structure, multi-channel evidence, and safety-aware evaluation. We introduce CockpitHAT, a hierarchical attribution framework that replaces positional windows with dependency-distance thresholds from interaction DAGs, integrates multi-channel evidence via an embodied adapter, and applies a safety-uplift to high-risk failures during confidence-weighted analyst consensus. We further release CockpitBench, a benchmark of 212 annotated failure traces spanning dialogue, vehicle-state, environmental, and memory channels, each labeled with ISO 26262 ASIL severity via three-expert consensus. On the public Who&When benchmark, CockpitHAT achieves agent-level / step-exact accuracies of 77.9% / 37.8% on the Hand-Crafted split and 86.5% / 46.0% on the Algorithm-Generated split, surpassing the text-only SOTA ECHO by up to 17.6 / 16.7 points. On CockpitBench, it attains 78.3% agent-level and 38.2% step-exact accuracy. These results establish dependency-aware, multi-channel, risk-calibrated attribution as an effective paradigm for reliable failure diagnosis in real-world embodied LLM multi-agent systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。