arXiv:2603.01260cs.LGcs.AI2026-03

MOSAIC让不同决策模型在同环境共存,实现公平对比。

MOSAIC: A Unified Platform for Cross-Paradigm Comparison and Evaluation of Homogeneous and Heterogeneous Multi-Agent RL, LLM, VLM, and Human Decision-Makers

  • 用IPC协议封装各类智能体,保持原逻辑不变
  • 支持RL、LLM、VLM与人类协同,结果可复现
  • 提供手动与自动双模式评估,适合跨范式研究

强化学习(RL)、大语言模型(LLMs)和视觉-语言模型(VLMs)长期被孤立研究。现有基础设施无法在同一环境中部署不同决策范式的智能体,难以在混合多智能体场景下进行公平比较。本文提出MOSAIC,一个开源平台,整合多种主流RL环境,使异构智能体(包括RL策略、LLMs、VLMs及人类玩家)能在临时组队中运行,并实现可复现的结果。MOSAIC有三项贡献:(i) 基于IPC的工作者协议,将原生与第三方框架封装为隔离子进程,通过版本化进程间通信协议交互;(ii) 操作器抽象,将各类工作者统一映射为智能体接口,无论其后端是RL、LLM或人类,均遵循最小统一接口;(iii) 确定性跨范式评估框架,包含两种互补模式:手动模式以共享种子同步推进最多N个操作器,便于细粒度行为观察;脚本模式通过声明式Python脚本驱动自动化长周期评估,确保实验可复现。MOSAIC以可视化优先设计,开放发布,推动RL、LLM与人机协同领域跨范式研究的可复现性发展。

原文摘要 · Abstract (English)

Reinforcement learning (RL), large language models (LLMs), and vision-language models (VLMs) have been widely studied in isolation. However, existing infrastructure lacks the ability to deploy agents from different decision-making paradigms within the same environment, making it difficult to study them in hybrid multi-agent settings or to compare their behaviour fairly under identical conditions. We present MOSAIC, an open-source platform that bridges this gap by incorporating a diverse set of existing reinforcement learning environments and enabling heterogeneous agents (RL policies, LLMs, VLMs, and human players) to operate within them in ad-hoc team settings with reproducible results. MOSAIC introduces three contributions. (i) An IPC-based worker protocol that wraps both native and third-party frameworks as isolated subprocess workers, each executing its native training and inference logic unmodified, communicating through a versioned inter-process protocol. (ii) An operator abstraction that forms an agent-level interface by mapping workers to agents: each operator, regardless of whether it is backed by an RL policy, an LLM, or a human, conforms to a minimal unified interface. (iii) A deterministic cross-paradigm evaluation framework offering two complementary modes: a manual mode that advances up to N concurrent operators in lock-step under shared seeds for fine-grained visual inspection of behavioural differences, and a script mode that drives automated, long-running evaluation through declarative Python scripts, for reproducible experiments. We release MOSAIC as an open, visual-first platform to facilitate reproducible cross-paradigm research across the RL, LLM, and human-in-the-loop communities.

多智能体跨范式评估平台可复现

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。