提出NaviCache,让视频生成模型在运行时自校准,减少计算量同时保持精度。
NaviCache: Test-Time Self-Calibration Caching for Video Generation

- 将特征变化类比为惯性导航,动态追踪输入输出差异
- 实测在多个视频生成数据集上跳过计算更准确,性能提升显著
- 适合追求高效推理的视频生成研究者与工程师
视频扩散模型(VDMs)受巨大计算成本制约。基于离线校准的加速方法存在依赖校准数据、校准时间过长及对分布偏移敏感等问题;而无须离线校准的方法虽克服了这些缺陷,但依赖瞬时零阶近似,导致对观测噪声敏感,并忽略扩散轨迹中的内在动量。本文提出NaviCache,一种即插即用的测试时自校准方法,将特征演化重新建模为惯性导航系统(INS)问题。通过建模输入与输出变化之间的相对耦合,引入双状态估计架构,自适应追踪特征变化率及其潜在漂移,初始化通过专用初始对准阶段完成。结合时变噪声调度与不确定性感知的测量更新机制,提供理论保障下的误差有界计算跳过策略。在HunyuanVideo、Wan和Open-Sora系列上的大量实验表明,NaviCache在计算跳过判断上更精准,综合表现优异。
原文摘要 · Abstract (English)
Video Diffusion Models (VDMs) is constrained by immense computational costs. While offline calibration-based acceleration suffers from calibration data dependency, prohibitive calibration duration, and susceptibility to distribution shifts, offline calibration-free methods eliminate these hurdles. However, since they rely on instantaneous zero-order approximations where the mapping between input and output differences varies in real-time, they are susceptible to observational noise and ignore the intrinsic momentum within the diffusion trajectory. In this paper, we propose NaviCache, a plug-and-play test-time self-calibration method re-conceptualizing feature evolution as an Inertial Navigation System (INS) problem. NaviCache bridges the fundamental domain gap and the non-stationary nature of diffusion by modeling the relative coupling between input and output variations. We introduce a dual-state estimation architecture that adaptively tracks the feature change ratio and its latent drift, initialized via a specialized Initial Alignment phase. By integrating a time-dependent noise schedule with an uncertainty-aware Measurement Update mechanism, NaviCache provides a theoretically grounded mechanism for error-bounded computation skipping. Extensive experiments on the HunyuanVideo, Wan, and Open-Sora series demonstrate that NaviCache exhibits more accurate error judgment for computation skipping and achieves outstanding comprehensive performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。