让自动驾驶仿真更真实:通过可控行为生成,提升交互场景的合理性。
BehaviorWorldGen: Closing the Loop between Action Models and World Simulators via Controllable Behavior-Aware Structured World Generation

- 用可控制的行为流模型生成多智能体交互轨迹,实现意图驱动的仿真。
- 在复杂交互场景中,行动模型的性能提升显著,最高达18.3%。
- 适合研究自动驾驶仿真、强化学习训练和交互行为建模的开发者。
现代自动驾驶动作模型通过自我改进循环持续优化,其中学习到的世界模拟器生成未来观测并反馈以改进动作模型。然而该循环的瓶颈在于模拟器无法生成周围智能体行为上合理的真实响应,导致生成数据在交互上不真实且分布失衡。本文提出BehaviorWorldGen框架,通过可控行为感知的结构化世界生成,闭合动作模型与世界模拟器之间的循环。其核心组件BehaviorFlow是一个元动作条件化的交通流模型,注入可解释的行为控制,联合生成多智能体轨迹。BehaviorFlow在实现指定智能体行为的同时,允许周围车辆对主体及彼此做出合理响应。生成的轨迹由世界模拟器渲染为多视角观测,并配以修正后的交互感知轨迹用于动作模型优化。由于采用结构化轨迹作为模块间接口,该框架兼容多种动作模型与世界模拟器。在世界生成、场景外推和策略优化实验中均表现出持续改进,尤其在困难交互场景中收益最大。
原文摘要 · Abstract (English)
Modern driving action models are increasingly improved in a self-improvement loop, where a learned world simulator imagines future observations and the resulting data is fed back to refine the action model. However, the bottleneck of this loop lies in the simulators' inability to generate behaviorally plausible responses by surrounding agents, making generated data both unrealistic in interaction and imbalanced in distribution. We introduce BehaviorWorldGen, a framework that closes the loop between action models and world simulators through controllable behavior-aware structured world generation. Its core component is BehaviorFlow, a meta-action-conditioned traffic-flow model that injects interpretable behavior controls and jointly generates multi-agent rollouts. BehaviorFlow realizes the specified agent behaviors while allowing surrounding vehicles to respond to the ego and to one another. The resulting rollouts are rendered by a world simulator into realistic multi-view observations, which are paired with corrected interaction-aware trajectories for action-model refinement. Since BehaviorWorldGen uses structured trajectories as the interface between its modules, it is compatible with diverse action models and world simulators. Experiments on world generation, scene extrapolation, and policy refinement demonstrate consistent improvements, with the largest benefits concentrated on difficult interactive scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。