arXiv:2507.07340cs.CV2025-07

用对比强化学习提升视觉故事中角色一致性,减少指代混乱。

Entity Re-identification in Visual Storytelling via Contrastive Reinforcement Learning

  • 设计对比强化学习框架,让模型学会区分连贯故事与无关图像。
  • 在真实故事中提升实体定位准确率14.8%,跨帧角色持续性提高13.7%。
  • 适合需要高一致性生成的视觉叙事系统开发者使用。

视觉讲故事系统,尤其是大规模视觉-语言模型,在跨帧保持角色和物体身份方面存在困难,常无法识别不同图像中的同一实体,导致指代不一致与幻觉。原因在于模型缺乏显式训练以判断何时建立跨帧实体关联。本文提出一种对比强化学习方法,通过区分连贯图像序列与无关图像来训练模型。我们在Story Reasoning数据集上添加合成负样本,以指导合理的实体连接行为。采用双组件奖励函数的直接偏好优化,促进真实故事中的实体定位与重识别,同时惩罚合成情境下的错误连接。在此框架下,对基于Qwen2.5-VL 7B的Qwen Storyteller进行微调。评估显示,定位mAP从0.27提升至0.31(+14.8%),F1从0.35升至0.41(+17.1%)。除“its”外,各类代词定位准确率均提升;跨帧角色与物体持续性在所有帧数下增强,出现在5帧以上实体的比例由29.3%增至33.3%(+13.7%)。结构良好故事(含思维链与事实依据)比例从79.1%升至97.5%(+23.3%)。

原文摘要 · Abstract (English)

Visual storytelling systems, particularly large vision-language models, struggle to maintain character and object identity across frames, often failing to recognize when entities in different images represent the same individuals or objects, leading to inconsistent references and referential hallucinations. This occurs because models lack explicit training on when to establish entity connections across frames. We propose a contrastive reinforcement learning approach that trains models to discriminate between coherent image sequences and stories from unrelated images. We extend the Story Reasoning dataset with synthetic negative examples to teach appropriate entity connection behavior. We employ Direct Preference Optimization with a dual-component reward function that promotes grounding and re-identification of entities in real stories while penalizing incorrect entity connections in synthetic contexts. Using this contrastive framework, we fine-tune Qwen Storyteller (based on Qwen2.5-VL 7B). Evaluation shows improvements in grounding mAP from 0.27 to 0.31 (+14.8%), F1 from 0.35 to 0.41 (+17.1%). Pronoun grounding accuracy improved across all pronoun types except "its", and cross-frame character and object persistence increased across all frame counts, with entities appearing in 5 or more frames advancing from 29.3% to 33.3% (+13.7%). Well-structured stories, containing the chain-of-thought and grounded story, increased from 79.1% to 97.5% (+23.3%).

视觉叙事实体重识别强化学习多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。