arXiv:2604.12213cs.AIcs.MA2026-04被引 1

让多模态信息在智能体间原生传递,能显著提升复杂任务准确率。

Modality-Native Routing in Agent-to-Agent Networks: A Multimodal A2A Protocol Extension

  • 基于智能体能力声明,按原始模态路由语音/图像/文本数据
  • 在跨模态基准上任务完成率达52%,比纯文本瓶颈高出20个百分点
  • 适合需要视觉等多模态推理的场景,如缺陷检测与故障排查

在智能体网络中保持多模态信号对跨模态推理至关重要,但仅此不够。我们发现,采用原生模态路由的A2A网络相比文本瓶颈基线,任务准确率提升20个百分点,但前提是下游推理智能体能利用原生路由保留的丰富上下文。当用关键词匹配替代大模型推理时,准确率差距消失(均为36%),表明需双层配合:协议层路由必须搭配具备强推理能力的智能体层才能见效。我们提出MMA2A,在A2A架构上增加一层,通过分析智能体卡的能力声明,将语音、图像和文本按原生模态路由。在同构后端、相同任务的跨模态CS基准(50项任务)上,MMA2A达成52%任务完成率,而基线为32%(95%置信区间ΔTCA:[8, 32] pp;McNemar精确p=0.006)。增益集中在视觉依赖任务:产品缺陷报告提升38.5个百分点,视觉排障提升16.7个百分点。该性能提升带来1.8倍延迟代价。结果表明,路由是多智能体系统的一阶设计变量,决定下游推理可获取的信息量。

原文摘要 · Abstract (English)

Preserving multimodal signals across agent boundaries is necessary for accurate cross-modal reasoning, but it is not sufficient. We show that modality-native routing in Agent-to-Agent (A2A) networks improves task accuracy by 20 percentage points over text-bottleneck baselines, but only when the downstream reasoning agent can exploit the richer context that native routing preserves. An ablation replacing LLM-backed reasoning with keyword matching eliminates the accuracy gap entirely (36% vs. 36%), establishing a two-layer requirement: protocol-level routing must be paired with capable agent-level reasoning for the benefit to materialize. We present MMA2A, an architecture layer atop A2A that inspects Agent Card capability declarations to route voice, image, and text parts in their native modality. On CrossModal-CS, a controlled 50-task benchmark with the same LLM backend, same tasks, and only the routing path varying, MMA2A achieves 52% task completion accuracy versus 32% for the text-bottleneck baseline (95% bootstrap CI on $Δ$TCA: [8, 32] pp; McNemar's exact $p = 0.006$). Gains concentrate on vision-dependent tasks: product defect reports improve by +38.5 pp and visual troubleshooting by +16.7 pp. This accuracy gain comes at a $1.8\times$ latency cost from native multimodal processing. These results suggest that routing is a first-order design variable in multi-agent systems, as it determines the information available for downstream reasoning.

多模态智能体网络路由机制跨模态推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。