arXiv:2601.04511cs.ROcs.LG2026-01被引 1

让机器人通过猜队友动作来协作,无需通信也能高效工作。

Multiagent Reinforcement Learning with Neighbor Action Estimation

  • 用轻量神经网络估算邻近智能体动作,仅靠本地信息推理。
  • 实测双机械臂协作抬物任务中,系统鲁棒性显著提升。
  • 适合通信受限的工业机器人、无人机等实际场景应用。

多智能体强化学习是实现复杂系统协同决策的重要范式。然而,现有方法通常依赖智能体间显式动作交换来评估动作价值函数,在真实工程环境中因通信约束、延迟、能耗和可靠性要求而难以实施。本文提出一种增强型多智能体强化学习框架,引入动作估计神经网络以推断智能体行为。通过集成轻量级动作估计模块,各智能体仅利用局部可观测信息即可推断邻近智能体的行为,从而在不共享显式动作的前提下实现协同策略学习。该方法与标准TD3算法完全兼容,可扩展至更大规模多智能体系统。在双机械臂协同抓举物体的工程应用中,实验结果表明,该方法显著提升了系统的鲁棒性与部署可行性,降低了对信息基础设施的依赖。本研究推动了去中心化多智能体人工智能系统的发展,使AI能在动态、信息受限的真实环境中有效运行。

原文摘要 · Abstract (English)

Multiagent reinforcement learning, as a prominent intelligent paradigm, enables collaborative decision-making within complex systems. However, existing approaches often rely on explicit action exchange between agents to evaluate action value functions, which is frequently impractical in real-world engineering environments due to communication constraints, latency, energy consumption, and reliability requirements. From an artificial intelligence perspective, this paper proposes an enhanced multiagent reinforcement learning framework that employs action estimation neural networks to infer agent behaviors. By integrating a lightweight action estimation module, each agent infers neighboring agents' behaviors using only locally observable information, enabling collaborative policy learning without explicit action sharing. This approach is fully compatible with standard TD3 algorithms and scalable to larger multiagent systems. At the engineering application level, this framework has been implemented and validated in dual-arm robotic manipulation tasks: two robotic arms collaboratively lift objects. Experimental results demonstrate that this approach significantly enhances the robustness and deployment feasibility of real-world robotic systems while reducing dependence on information infrastructure. Overall, this research advances the development of decentralized multiagent artificial intelligence systems while enabling AI to operate effectively in dynamic, information-constrained real-world environments.

多智能体强化学习机器人协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。