C-World可按需生成大规模智能体训练环境,支持真实与虚拟双模式运行。
C-World: A Computer Use Agent Environment Creator
- 构建四组件环境:5571个工具、任务生成器、状态控制器、多维奖励信号
- 虚拟引擎与真实执行相关性达0.883,1170条轨迹优于119k样本基线
- 适合研究智能体规划与执行瓶颈,尤其关注约束遵循能力
为缩小基于大模型的智能体与人类在规划与推理上的差距,智能体需要大规模、多样化的持续学习环境——但构建此类环境成本极高。我们提出C-World,一个可按需创建智能体环境的系统。通过四个核心组件定义完整环境:包含204个常见应用中5571个格式统一的工具的动作空间;能合成具有复杂约束的长周期工作流的任务分布引擎;注入真实故障与扰动的状态控制器(转换函数);结合可验证指标与大模型判断的奖励信号。C-World支持两种模式:基于实时API调用的真实模式,以及由世界引擎驱动的合成模式,后者可在无实际服务访问时模拟工具行为,实现规模化环境生成,甚至涵盖现实世界尚未存在的领域与工具。对九个前沿大模型的评估显示,规划能力普遍较强,但执行仍是瓶颈,且约束遵循(而非工具调用)是主要失败原因。世界引擎与真实执行的斯皮尔曼相关系数达0.883,仅用1170条C-World轨迹微调即超越在119,000样本上训练的基线,证明其兼具严谨评估环境与可扩展数据引擎的双重价值。代码与数据已公开于https://ziqiao-git.github.io/C-World/
原文摘要 · Abstract (English)
To close the gap between LLM-based agents and humans in planning and reasoning, agents need large-scale, diverse environments for continuous learning -- yet building such environments is itself prohibitively expensive. We present C-World, an environment creation system that enables users to build agent environments on demand. We define a complete agent environment through four components: an Action Space of 5,571 format-unified tools across 204 common applications, a Task Distribution engine that synthesizes long-horizon workflows with wild constraints, a Transition Function implemented as a state controller that injects realistic failures and perturbations, and a Reward Signal combining verifiable metrics with LLM-based judgment. C-World operates in two modes: a realistic mode grounded in live API execution, and a synthesized mode powered by the World Engine, which approximates tool behavior without live service access, enabling scalable environment creation -- including environments for domains and tools that do not yet exist in the real world. Evaluation of nine state-of-the-art LLMs reveals that planning ability is uniformly strong but execution remains the bottleneck, and that constraint following -- not tool invocation -- is the dominant failure mode. The World Engine achieves Spearman $ρ= 0.883$ ranking correlation with real execution, and fine-tuning on just 1,170 C-World trajectories outperforms baselines trained on 119k samples, demonstrating C-World's dual value as a rigorous evaluation environment and a scalable data engine. Our code and data are available at https://ziqiao-git.github.io/C-World/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。