arXiv:2601.03413cs.LGcs.MA2026-01

用图像强化学习让多智能体高效聚拢,无需复杂感知设计。

Sensor to Pixels: Decentralized Swarm Gathering via Image-Based Reinforcement Learning

  • 将传感器数据转为图像输入,通过神经网络提取空间特征实现分布式控制
  • 在有限视野仅测方向的条件下,收敛速度接近最快基准,成功率更高
  • 适合对感知精度要求高、需快速聚拢的机器人集群场景

本研究探索基于图像的强化学习方法在多智能体协同任务中的潜力。在多智能体强化学习中,策略的有效性依赖于智能体对输入信息的感知、解读与处理方式。传统方法通常采用手工特征提取或原始向量表示,限制了策略在输入顺序和规模上的可扩展性与效率。本文提出一种基于图像的强化学习方法,用于去中心化控制多智能体系统,将观测值编码为结构化视觉输入,由神经网络处理以提取空间特征,并生成新的分布式运动控制规则。我们在一个多智能体汇聚任务上评估该方法,智能体仅有短程且仅能测量方向的感知能力,目标是在聚合过程中保持群体紧密。算法性能对比两种基准:由Bellaiche和Bruckstein提出的解析解,虽能保证收敛但速度慢;VariAntNet,一种基于神经网络的框架,收敛快但面对复杂构型时成功率中等。本文方法在多数场景下实现高收敛率,收敛速度接近VariAntNet,在部分场景中成为唯一可行方案。

原文摘要 · Abstract (English)

This study highlights the potential of image-based reinforcement learning methods for addressing swarm-related tasks. In multi-agent reinforcement learning, effective policy learning depends on how agents sense, interpret, and process inputs. Traditional approaches often rely on handcrafted feature extraction or raw vector-based representations, which limit the scalability and efficiency of learned policies concerning input order and size. In this work we propose an image-based reinforcement learning method for decentralized control of a multi-agent system, where observations are encoded as structured visual inputs that can be processed by Neural Networks, extracting its spatial features and producing novel decentralized motion control rules. We evaluate our approach on a multi-agent convergence task of agents with limited-range and bearing-only sensing that aim to keep the swarm cohesive during the aggregation. The algorithm's performance is evaluated against two benchmarks: an analytical solution proposed by Bellaiche and Bruckstein, which ensures convergence but progresses slowly, and VariAntNet, a neural network-based framework that converges much faster but shows medium success rates in hard constellations. Our method achieves high convergence, with a pace nearly matching that of VariAntNet. In some scenarios, it serves as the only practical alternative.

多智能体图像强化学习分布式控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。