arXiv:2605.06595cs.ROcs.AI2026-05被引 1

多智能体强化学习提升跨模态导航性能,实现高效协作与灵活部署。

Cross-Modal Navigation with Multi-Agent Reinforcement Learning

论文配图:Cross-Modal Navigation with Multi-Agent Reinforcement Learning
图 1 · 摘自论文原文
  • 设计轻量级专用智能体,通过多智能体协同完成跨模态导航。
  • 在视觉-听觉任务中,多智能体方法优于单智能体基线,效率更高。
  • 异构智能体协作更适合复杂环境,需更强感知与模型容量。

可靠的具身导航依赖于互补的感官线索,但实践中高质量且对齐的多模态数据往往难以获取。训练单一模型也因丰富的多模态输入导致表示复杂化,显著扩大策略空间。轻量级模态专用智能体之间的跨模态协作提供了一种可扩展的范式,支持灵活部署和并行执行,同时保留各模态优势。本文提出 extbf{CRONA},一种用于 extbf{Cro}ss-Modal extbf{Na}vigation 的多智能体强化学习(MARL)框架。CRONA 通过利用控制相关的辅助信念和包含全局状态的集中式多模态评论家,改进协作效果。在视觉-听觉导航任务上的实验表明,多智能体方法显著优于单智能体基线,在性能和效率上均有提升。研究发现:在显著线索下,有限模态的同质协作足以应对短距离导航;具有互补模态的异质协作通常更高效有效;而在大而复杂的环境中,需要更丰富的多模态感知和更高的模型容量。

原文摘要 · Abstract (English)

Robust embodied navigation relies on complementary sensory cues. However, high-quality and well-aligned multi-modal data is often difficult to obtain in practice. Training a monolithic model is also challenging as rich multi-modal inputs induce complex representations and substantially enlarge the policy space. Cross-modal collaboration among lightweight modality-specialized agents offers a scalable paradigm. It enables flexible deployment and parallel execution, while preserving the strength of each modality. In this paper, we propose \textbf{CRONA}, a Multi-Agent Reinforcement Learning (MARL) framework for \textbf{Cro}ss-Modal \textbf{Na}vigation. CRONA improves collaboration by leveraging control-relevant auxiliary beliefs and a centralized multi-modal critic with global state. Experiments on visual-acoustic navigation tasks show that multi-agent methods significantly improve performance and efficiency over single-agent baselines. We find that homogeneous collaboration with limited modalities is sufficient for short-range navigation under salient cues; heterogeneous collaboration among agents with complementary modalities is generally efficient and effective; and navigation in large, complex environments requires both richer multi-modal perception and increased model capacity.

多智能体导航强化学习跨模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。