arXiv:2601.01139cs.ROcs.MA2026-01

用压缩空间提升多机器人探索效率,支持复杂环境自适应导航。

Latent Space Reinforcement Learning for Multi-Robot Exploration

  • 用自编码器将高精度地图压缩为低维潜在向量,保留关键空间信息。
  • 在模拟陨石带、洞穴等复杂环境中训练,多智能体可扩展且通信受限下仍稳定。
  • 引入可调信任参数的共识机制,减少错误累积,适合实际部署场景。

自主映射未知环境是时间紧迫场景下的关键挑战。多智能体系统可通过协作提升效率,但运动规划算法的可扩展性仍是主要限制。强化学习虽被探索用于解决此问题,但现有方法受限于输入尺寸,难以应用于连续环境。本文通过自编码器实现维度压缩,将高保真占用图转化为保留核心空间信息的潜在状态向量。同时,提出基于Perlin噪声的新型程序化生成算法,构建拓扑复杂的训练环境,模拟陨石带、洞穴与森林。这些环境用于在分层深度强化学习框架下训练自编码器与导航算法,实现去中心化协调。引入加权共识机制,通过可调信任参数调节对共享数据的依赖,增强对误差累积的鲁棒性。实验表明,该系统在智能体数量增加时仍能有效扩展,对结构迥异的陌生环境具有良好泛化能力,并在通信受限条件下表现稳健。

原文摘要 · Abstract (English)

Autonomous mapping of unknown environments is a critical challenge, particularly in scenarios where time is limited. Multi-agent systems can enhance efficiency through collaboration, but the scalability of motion-planning algorithms remains a key limitation. Reinforcement learning has been explored as a solution, but existing approaches are constrained by the limited input size required for effective learning, restricting their applicability to discrete environments. This work addresses that limitation by leveraging autoencoders to perform dimensionality reduction, compressing high-fidelity occupancy maps into latent state vectors while preserving essential spatial information. Additionally, we introduce a novel procedural generation algorithm based on Perlin noise, designed to generate topologically complex training environments that simulate asteroid fields, caves and forests. These environments are used for training the autoencoder and the navigation algorithm using a hierarchical deep reinforcement learning framework for decentralized coordination. We introduce a weighted consensus mechanism that modulates reliance on shared data via a tuneable trust parameter, ensuring robustness to accumulation of errors. Experimental results demonstrate that the proposed system scales effectively with number of agents and generalizes well to unfamiliar, structurally distinct environments and is resilient in communication-constrained settings.

多机器人强化学习空间压缩自主探索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。