arXiv:2605.05187cs.CV2026-05被引 4

首个4D世界模型综合质量评估挑战,评测生成视频的物理合理性与时空一致性。

LoViF 2026 The First Challenge on Holistic Quality Assessment for 4D World Model (PhyScore)

论文配图:LoViF 2026 The First Challenge on Holistic Quality Assessment for 4D World Model (PhyScore)
图 1 · 摘自论文原文
  • 构建多维度评分体系,同时评估视频质量、物理真实性、条件对齐和时序连贯性。
  • 在1554个由7个主流模型生成的视频上,实现物理异常时间点精准定位。
  • 适用于评估生成视频的物理合理性和动态一致性,适合模型开发者与评测研究者。

本文报告了LoViF 2026 PhyScore挑战赛,这是首个针对世界模型生成视频的综合质量评估竞赛,涵盖2D与4D生成场景。当前评估仅关注感知质量,难以判断生成动态是否符合物理规律、时序是否连贯及与输入条件一致。参赛者需构建能联合预测四个维度(视频质量、物理真实性、条件-视频对齐、时序一致性)的度量方法,并定位物理异常的时间戳以支持细粒度诊断。基准数据集包含1,554个视频,由7个代表性世界生成模型产生,分为三个赛道(文本→2D、图像→4D、视频→4D),覆盖26类场景,涵盖动力学、光学、热力学等物理相关任务,以及真实世界与创意内容。标签通过训练后的人工标注生成,并经自动化质检保障可靠性。评估基于分数预测与异常定位,采用结合TimeStamp_IOU与SRCC/PLCC的复合协议。本文总结挑战设计,并提供提交方案的方法级洞察。

原文摘要 · Abstract (English)

This paper reports on the LoViF 2026 PhyScore challenge, a competition on holistic quality assessment of world-model-generated videos across both 2D and 4D generation settings. The challenge is motivated by a central gap in current evaluation practice: perceptual quality alone is insufficient to judge whether generated dynamics are physically plausible, temporally coherent, and consistent with input conditions. Participants are required to build a metric that jointly predicts four dimensions, i.e., Video Quality, Physical Realism, Condition-Video Alignment, and Temporal Consistency. Depart from that, participants also need to localize physical anomaly timestamps for fine-grained diagnosis. The benchmark dataset contains 1,554 videos generated by seven representative world generative models, organized into three tracks (text-2D, image-to-4D, and video-to-4D) and spanning 26 categories. These categories explicitly cover physics-relevant scenarios, including dynamics, optics, and thermodynamics, together with diverse real-world and creative content. To ensure label reliability, scores and anomaly timestamps are produced through trained human annotation with an additional automated quality-control pass. Evaluation is based on both score prediction and anomaly localization, with a composite protocol that combines TimeStamp_IOU and SRCC/PLCC. This report summarizes the challenge design and provides method-level insights from submitted solutions.

4D生成物理评估质量评测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。