构建长序列多镜头视频生成的实体一致性评测基准
EntityBench: Towards Entity-Consistent Long-Range Multi-Shot Video Generation

- 设计跨镜头实体调度机制,支持50镜头内角色、场景、物体持续追踪
- 现有方法在48镜头间隔后实体一致性骤降,新模型提升角色保真度2.33倍
- 适合研究长程视频生成、角色一致性与记忆增强模型的学者使用
多镜头视频生成拓展了单镜头生成能力,实现连贯视觉叙事,但长序列中保持角色、物体和场景的一致性仍具挑战。现有评估多采用独立生成提示集,实体覆盖有限且一致性指标简单,难以标准化比较。本文提出EntityBench,一个基于真实叙事媒体构建的基准,包含140个剧情单元(共2,491个镜头),涵盖易/中/难三类难度,最长可达50镜头,涉及13个跨镜头角色、8个跨镜头场景、22个跨镜头物体,以及最长48镜头的重复间隔。配套三支柱评估体系分离镜头内质量、提示对齐与跨镜头一致性,并引入保真度门控,仅允许准确出现的实体参与一致性评分。作为基线,提出EntityMem,一种在生成前将验证过的实体视觉特征存入持久化记忆库的记忆增强生成系统。实验表明,现有方法在远距离重复时一致性显著下降,而显式实体记忆可大幅提升角色保真度(Cohen's d = +2.33)与存在感。代码与数据已开源。
原文摘要 · Abstract (English)
Multi-shot video generation extends single-shot generation to coherent visual narratives, yet maintaining consistent characters, objects, and locations across shots remains a challenge over long sequences. Existing evaluations typically use independently generated prompt sets with limited entity coverage and simple consistency metrics, making standardized comparison difficult. We introduce EntityBench, a benchmark of 140 episodes (2,491 shots) derived from real narrative media, with explicit per-shot entity schedules tracking characters, objects, and locations simultaneously across easy / medium / hard tiers of up to 50 shots, 13 cross-shot characters, 8 cross-shot locations, 22 cross-shot objects, and recurrence gaps spanning up to 48 shots. It is paired with a three-pillar evaluation suite that disentangles intra-shot quality, prompt-following alignment, and cross-shot consistency, with a fidelity gate that admits only accurate entity appearances into cross-shot scoring. As a baseline, we propose EntityMem, a memory-augmented generation system that stores verified per-entity visual references in a persistent memory bank before generation begins. Experiments show that cross-shot entity consistency degrades sharply with recurrence distance in existing methods, and that explicit per-entity memory yields the highest character fidelity (Cohen's d = +2.33) and presence among methods evaluated. Code and data are available at https://github.com/Catherine-R-He/EntityBench/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。