arXiv:2606.26575cs.ROcs.AI2026-06

通过效果对齐提升多智能体仿真到现实的迁移鲁棒性

IDEA: Insensitive to Dynamics Mismatch via Effect Alignment for Sim-to-Real Transfer in Multi-Agent Control

论文配图:IDEA: Insensitive to Dynamics Mismatch via Effect Alignment for Sim-to-Real Transfer in Multi-Agent Control
图 1 · 摘自论文原文
  • 用语义动作与闭环控制,将策略学习提升到抽象层面
  • 在4个导航任务中,训练效率更高且真实场景成功率显著提升
  • 适合动态不匹配严重的多智能体系统部署

复杂多智能体控制任务对传统规则和模型驱动方法仍具挑战,促使学习型方法的应用。然而,学习型方法常因依赖精确动力学建模、在低层控制空间学习而对动力学不匹配敏感,导致在复杂环境中成本高且脆弱。为此,我们提出一种基于效果对齐的多智能体仿真到现实迁移方法,对动力学不匹配不敏感。该方法结合随机环境结构与离散语义动作,通过闭环控制将策略学习提升至语义抽象层级;同时设计动作同步机制,缓解智能体间动作时序错位,增强系统时间一致性。在四个多智能体导航任务上的实验表明,本方法显著优于主流迁移方法,训练效率更高,真实场景成功率大幅提升,有效提升了多智能体系统在动力学不匹配下的鲁棒性与部署稳定性。

原文摘要 · Abstract (English)

Complex multi-agent control tasks remain challenging for traditional rule-based and model-based approaches, motivating the adoption of learning-based methods. However, learning-based methods often struggle with sim-to-real transfer because they rely on accurate dynamics modeling or system identification and learn policies in low-level control spaces that are highly sensitive to dynamics mismatch, making them costly and fragile in complex environments. To address this issue, we propose a sim-to-real method for multi-agent control, which is insensitive to dynamics mismatch via effect alignment. Our method combines random environmental structure with discrete semantic actions through closed-loop control, elevating policy learning to a semantic abstraction level. Additionally, we develop an action synchronization mechanism that mitigates inter-agent action timing mismatches, thereby enhancing the temporal consistency of the system. Experiments on four multi-agent navigation tasks demonstrate that our method substantially improves training efficiency over mainstream transfer methods and achieves higher success rates in real-world scenarios, thereby improving the robustness and deployment stability of multi-agent systems under dynamics mismatch.

多智能体仿真到现实策略迁移语义控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。