arXiv:2603.10349cs.CV2026-03中稿 · ICME

让故事生成带情绪,视觉表达更打动人心

EmoStory: Emotion-Aware Story Generation

  • 分两阶段生成:先规划情绪化剧情,再精准控制画面情感元素
  • 在25个主体、600条故事上测试,情绪准确率和一致性显著提升
  • 适合想做有情感感染力的叙事视觉创作的研究者或开发者

故事生成旨在生成连贯的图像序列,保持角色在帧间的统一性。现有方法虽能产出连贯且富有表现力的故事,但普遍缺乏情感表达,仅关注角色出现而忽视情绪如何影响叙事理解与视觉呈现。由于故事本应引发观众情感共鸣,我们提出情感感知的故事生成新任务,目标是生成角色一致且带有明确情感导向的视觉故事。该任务因情绪抽象性而具挑战性,需将情绪具体化为视觉元素,并在叙事中持续体现。为此,我们提出EmoStory框架,包含基于代理的故事情节规划与区域感知的故事生成两个阶段。规划阶段通过情绪代理和写作者代理将目标情绪转化为连贯故事提示;生成阶段则通过区域感知的构图保持角色一致并注入情绪相关元素。我们在新构建的数据集上评估EmoStory,覆盖25个主体和600条情感故事。大量定量与定性结果及用户研究显示,EmoStory在情绪准确性、提示对齐度和角色一致性方面均优于现有最先进方法。

原文摘要 · Abstract (English)

Story generation aims to produce image sequences that depict coherent narratives while maintaining subject consistency across frames. Although existing methods have excelled in producing coherent and expressive stories, they remain largely emotion-neutral, focusing on what subject appears in a story while overlooking how emotions shape narrative interpretation and visual presentation. As stories are intended to engage audiences emotionally, we introduce emotion-aware story generation, a new task that aims to generate subject-consistent visual stories with explicit emotional directions. This task is challenging due to the abstract nature of emotions, which must be grounded in concrete visual elements and consistently expressed across a narrative through visual composition. To address these challenges, we propose EmoStory, a two-stage framework that integrates agent-based story planning and region-aware story generation. The planning stage transforms target emotions into coherent story prompts with emotion agent and writer agent, while the generation stage preserves subject consistency and injects emotion-related elements through region-aware composition. We evaluate EmoStory on a newly constructed dataset covering 25 subjects and 600 emotional stories. Extensive quantitative and qualitative results, along with user studies, show that EmoStory outperforms state-of-the-art story generation methods in emotion accuracy, prompt alignment, and subject consistency.

故事生成情感识别视觉叙事

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。