arXiv:2601.08510cs.CLcs.AI2026-01被引 2

构建首个全流程剧本推理基准,测试模型对角色状态演化的跟踪能力。

STAGE: A Full-Screenplay Benchmark for Reasoning over Evolving Stories

  • 基于剧情溯源架构,还原角色在每幕中的状态与认知
  • 三类任务验证模型能否追踪、解释并响应角色演化
  • 揭示大模型在角色扮演中记忆与风格的权衡缺陷

电影剧本是长篇叙事理解的严苛测试场,因角色目标、信念、知识和关系随场景持续演变。现有基准多评估完成剧本中的孤立事实,未能检验模型是否能追踪故事展开过程中角色状态的动态变化。我们提出STAGE,一个覆盖151部英汉全剧本的基准,基于可追溯的叙事骨架,重建每个角色在时间线各节点的状态与认知访问。三个任务共同检验模型能否维护、解释并依据演化中的叙事状态进行行动:角色发展追踪(在检查点间更新焦点角色状态)、跨场景叙事演化推理(分析跨场景状态转移)、剧中角色扮演(在指定时刻以角色状态与知识为约束生成回应)。我们识别出当前大模型三大失败模式:递归状态更新下的沉默遗忘、即使提供全部证据仍限于跨场景推理、角色扮演中风格忠实度与剧本记忆准确性之间的权衡——不同记忆访问策略分别优化二者。STAGE为此提供了统一框架,诊断当前模型在追踪、推理与演绎故事演化上的局限。

原文摘要 · Abstract (English)

Movie screenplays are a demanding testbed for long-form narrative understanding, as characters' goals, beliefs, knowledge, and relationships evolve continuously across scenes. However, existing benchmarks primarily evaluate isolated facts from the completed screenplay, leaving unassessed whether models can track the evolving state of characters as the story unfolds. We introduce STAGE, a benchmark over 151 English and Chinese full-length screenplays, built on a provenance-linked narrative backbone that recovers the state and epistemic access of each character at every point along its timeline. Three tasks derived from the backbone jointly probe whether models can maintain, explain, and act on evolving narrative state: Character Development Tracking updates a focal character's state between checkpoints, Cross-Scene Narrative Evolution Reasoning targets cross-scene state transitions, and In-Script Character Role-Playing requires responses bounded by the character's state and knowledge at a specified point. We identify three failure modes of current LLMs: silent forgetting under recursive state updating, limited cross-scene reasoning even when all relevant evidence is supplied, and a trade-off in role-playing where stylistic character fidelity and screenplay-grounded memory faithfulness are optimized by different memory-access strategies. STAGE thus provides a unified framework for diagnosing how current models fail to track, reason about, and enact story evolution.

叙事理解角色演化大模型评测剧本推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。