arXiv:2608.28694cs.CV2026-08

提出新评估框架,精准区分视频生成中的真实运动与背景漂移。

SNF-Bench: Separating Static Drift from Natural Flow in Long-Horizon Fixed-Camera Video Generation

论文配图:SNF-Bench: Separating Static Drift from Natural Flow in Long-Horizon Fixed-Camera Video Generation
图 1 · 摘自论文原文
  • 将画面分为静态背景与动态流,分别评估其质量
  • 发现运动指标会误奖背景漂移,导致排名颠倒
  • 适合关注生成稳定性与真实感的研究者使用

长时序固定摄像头视频生成常依赖整体帧指标,奖励运动与时间一致性。但对自然场景而言,水流、火焰等运动可接受,而背景漂移是错误。系统可能在运动得分高但场景漂移,或在一致性高但流动停滞。我们提出SNF-Bench评估框架,将每幅场景分解为静态支持与动态流,分别报告静态保真度、流动持久性(含绝对幅度)和漂移泄漏,不合并为单一分数。漂移泄漏作为解释性上下文而非核心指标。各维度通过机制验证:注入全局平移、旋转、缩放漂移及渐进晚期冻结,确保每个指标响应方向正确且对非目标干扰保持选择性。在统一推理配置下审计公开的文本条件模型,及图像条件模型与部署敏感性分析,发现运动与静态区域漂移对同一输出排序近乎相反。最大可控平移下,fBD与NBF分别升至1.86倍和1.32倍基线,但全帧动态度仅达1.07倍——反而奖励了人为扰动。SNF-Bench衡量运动位置与持续性,不评估物理真实性。

原文摘要 · Abstract (English)

Long-horizon video generation is evaluated with whole-frame metrics that reward motion and temporal consistency. For fixed-camera nature scenes this creates an ambiguity: motion of water, fire, smoke, or rain is desirable, whereas motion of the background is an error. A system can therefore score well on motion while its scene drifts, or on consistency while its flow stagnates. We introduce SNF-Bench, an evaluation framework for long-horizon fixed-camera generation that partitions each scene into static support and dynamic flow and reports static fidelity, flow persistence with absolute magnitude, and drift leakage separately, never as one score. Drift leakage is interpretive context rather than a headline measurement. Each factor is validated mechanistically rather than by correlation with preference: we inject global translation, rotation, and scale drift and progressive late freezing at known severity into real generations, and require each factor to respond in its stated direction and to remain selective against corruptions it does not target. Auditing publicly released long-horizon text-conditioned checkpoints under one recorded common inference configuration, plus an image-conditioned track with released-pipeline references and a deployment-sensitivity panel, we find that whole-frame motion and static-region drift induce near-opposite orderings of the same outputs. At maximum controlled translation, fBD and NBF rise to $1.86\times$ and $1.32\times$ baseline, but whole-frame Dynamic Degree reaches only $1.07\times$---rewarding the corruption. SNF-Bench measures where motion occurs and whether it persists; it does not measure physical realism. Project page: https://minar09.github.io/snfbench/.

视频生成评估框架稳定性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。