解决交通信号控制中传感器差异导致的观测不匹配问题
Planning Under Observation Mismatch for Traffic Signal Control via Adaptive Modular World Models
- 采用模块化架构分离观测适配器与共享动态模型
- 在新场景下仅需少量交互即可快速适应,提升数据效率
- 适合跨域交通信号控制,尤其适用于传感器配置不同的城市
部署学习型决策系统时常需迁移至感知管道不同的新站点,此时观测的语义和维度可能变化,但动作原语和目标保持一致。本文研究在观测不匹配下的可迁移模型规划问题,现有基于学习的方法难以应对。提出自适应模块化模型(AMM),将领域特定的观测适配器与共享的内部动态模型解耦,后者在多个源域上元学习,以实现有限目标交互下的快速适应。运行时,AMM通过滚动时域规划,对候选动作序列进行动态预测,并选择使任务目标最优的动作。在跨域交通信号控制中验证,动作对应信号相位,规划目标为缓解拥堵。实验表明,相比传统控制器和学习基线,AMM显著提升性能并增强数据效率。
原文摘要 · Abstract (English)
Deploying learned decision-making systems often requires transferring to new sites where the sensing pipeline differs. In such cases, observations can change in semantics and dimensionality even when action primitives and objectives remain comparable. In this work, we study transferable model-based planning under this observation mismatch, which remains challenging for existing learning-based approaches. We propose Adaptive Modularized Model (AMM), a modular planning architecture that separates a domain-specific observation adapter from a shared internal dynamics model defined in a common planning state space. The dynamics model is meta-learned from multiple source domains to enable fast adaptation with limited target interaction. At run time, AMM performs receding-horizon planning by rolling out candidate action sequences under the learned dynamics and selecting actions that optimize a task-specific objective over predicted futures. We instantiate the approach on cross-domain traffic signal control, where actions correspond to signal phases and the planning objective captures congestion. Experiments show that AMM improves both performance and data efficiency compared with existing conventional controllers and learning-based baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。