arXiv:2602.02110cs.LGcs.CV2026-02被引 2

研究世界模型量化对规划任务的影响,发现低比特量化会引发不可逆失败。

An Empirical Study of World Model Quantization

  • 对比不同量化方法在权重与激活上的效果
  • 4位量化时规划成功率下降超50%,且无法通过优化恢复
  • 编码器比预测模块对量化更敏感,适合分层优化

世界模型通过内部表征环境动态,在紧凑隐空间中实现未来状态的模拟与推理。然而其运行依赖高计算成本和内存开销,量化成为高效部署的关键。现有研究尚未系统评估后训练量化(PTQ)对世界模型的影响。本文以DINO-WM为例,系统评估多种PTQ方法在仅权重和联合权重-激活设置下的表现,覆盖不同视觉规划任务、比特位宽、量化粒度及长达50步的规划时序。结果表明:量化影响远超传统精度与比特权衡——分组权重量化可稳定低比特推演,激活量化粒度收益不一致,且编码器与预测模块的量化敏感性高度不对称。极端低比特量化显著破坏规划目标与任务成功间的对齐,导致失败不可逆。这些发现揭示了基于世界模型规划中的独特量化失效模式,为严苛计算约束下的部署提供实践指导。代码将公开于https://github.com/huawei-noah/noah-research/tree/master/QuantWM。

原文摘要 · Abstract (English)

World models learn an internal representation of environment dynamics, enabling agents to simulate and reason about future states within a compact latent space for tasks such as planning, prediction, and inference. However, running world models rely on hevay computational cost and memory footprint, making model quantization essential for efficient deployment. To date, the effects of post-training quantization (PTQ) on world models remain largely unexamined. In this work, we present a systematic empirical study of world model quantization using DINO-WM as a representative case, evaluating diverse PTQ methods under both weight-only and joint weight-activation settings. We conduct extensive experiments on different visual planning tasks across a wide range of bit-widths, quantization granularities, and planning horizons up to 50 iterations. Our results show that quantization effects in world models extend beyond standard accuracy and bit-width trade-offs: group-wise weight quantization can stabilize low-bit rollouts, activation quantization granularity yields inconsistent benefits, and quantization sensitivity is highly asymmetric between encoder and predictor modules. Moreover, aggressive low-bit quantization significantly degrades the alignment between the planning objective and task success, leading to failures that cannot be remedied by additional optimization. These findings reveal distinct quantization-induced failure modes in world model-based planning and provide practical guidance for deploying quantized world models under strict computational constraints. The code will be available at https://github.com/huawei-noah/noah-research/tree/master/QuantWM.

世界模型量化规划低比特

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。