用多个大模型代理实现机器人社交导航,自适应复杂人群环境。
Multi-Agent LLM Actor-Critic Framework for Social Robot Navigation
- 多智能体框架让每个机器人独立生成动作,提升灵活性。
- 双层验证机制确保行为合规,熵值融合增强自我纠错能力。
- 适合研究人机协作、多机器人系统或社交导航的开发者。
近年来,机器人与大语言模型(LLMs)的发展推动了人机协作与具身智能的研究。为使机器人在有人环境中更广泛部署,社交感知机器人导航(SAN)成为关键方向。尽管深度强化学习结合人机交互与路径规划在基准测试中表现优异,但往往难以适应新场景。大语言模型可通过常识推理实现零样本导航,但现有方法多依赖集中决策,缺乏有效验证机制,且高层动作到低层控制信号的转换常不一致。为此,我们提出SAMALM——一种去中心化的多智能体大模型演员-评论家框架,用于多机器人社交导航。框架中一组并行的LLM演员(代表不同机器人个性或配置)直接生成控制信号,通过全局评论家评估群体行为、个体评论家评估上下文合理性进行两级验证。基于熵的评分融合机制进一步提升自验证与重查询能力,增强鲁棒性与协同性。实验表明,SAMALM有效平衡局部自主与全局监督,在多种多机器人场景中均实现社会合规行为与强适应性。更多细节与视频见:https://sites.google.com/view/SAMALM。
原文摘要 · Abstract (English)
Recent advances in robotics and large language models (LLMs) have sparked growing interest in human-robot collaboration and embodied intelligence. To enable the broader deployment of robots in human-populated environments, socially-aware robot navigation (SAN) has become a key research area. While deep reinforcement learning approaches that integrate human-robot interaction (HRI) with path planning have demonstrated strong benchmark performance, they often struggle to adapt to new scenarios and environments. LLMs offer a promising avenue for zero-shot navigation through commonsense inference. However, most existing LLM-based frameworks rely on centralized decision-making, lack robust verification mechanisms, and face inconsistencies in translating macro-actions into precise low-level control signals. To address these challenges, we propose SAMALM, a decentralized multi-agent LLM actor-critic framework for multi-robot social navigation. In this framework, a set of parallel LLM actors, each reflecting distinct robot personalities or configurations, directly generate control signals. These actions undergo a two-tier verification process via a global critic that evaluates group-level behaviors and individual critics that assess each robot's context. An entropy-based score fusion mechanism further enhances self-verification and re-query, improving both robustness and coordination. Experimental results confirm that SAMALM effectively balances local autonomy with global oversight, yielding socially compliant behaviors and strong adaptability across diverse multi-robot scenarios. More details and videos about this work are available at: https://sites.google.com/view/SAMALM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。