arXiv:2507.13841cs.CL2025-07

用信息论分析叙事中的意外与连贯性矛盾,提出公平解谜的计算框架。

The Challenge and Reward of Fair Play in Narrative: A Computational Approach

  • 区分读者预揭秘与事后回顾两种认知模式,化解意外与连贯的冲突
  • 实验表明大模型难同时实现意外、连贯与公平解谜,三者不可兼得
  • 新指标验证了阿加莎·克里斯蒂比柯南·道尔更惊喜且更公平

优秀叙事包含意外性(故事展开不可预测)与可理解性(情节连贯)两个维度,但以往研究多孤立处理。本文以侦探小说为范例,在信息论框架下形式化二者关系:单个读者模型下,意外与连贯必然权衡;但若区分预揭示与事后回溯两种阅读模式,则可共存。这种平衡体现于文学中的‘公平游戏’原则——读者有解谜机会,又面临挑战。我们利用大语言模型作为模拟读者,构建无需参考文本的评估指标,用于衡量意外性、连贯性与公平性。在LLM生成的故事上验证理论预测:模型普遍能实现意外或连贯,但难以兼顾三者。跨故事分析显示,意外与连贯无正相关,无法简化为单一潜变量。人类实验验证指标有效性,其结果符合经典文学判断:克里斯蒂作品比道尔更具意外性与公平性。

原文摘要 · Abstract (English)

Good storytelling involves surprise -- unpredictability in how the story unfolds -- and sense-making, the requirement that the story forms a coherent sequence. However, to date, these two qualities have largely been addressed in isolation. We formalize these qualities and their relationship in an information-theoretic framework, using detective fiction as a paradigm case of narratives in which a hidden truth is discovered through reasoning. Our central theoretical result shows that surprise and coherence must trade off for any *single* reader model, but can coexist when two reader modes are distinguished: a pre-revelation mode that forms expectations while the ending is unknown, and a post-resolution hindsight mode that re-evaluates the story after the culprit is revealed. The balance of these two dimensions is realized in the common requirement of *fair play*, giving the reader a chance to solve the mystery while maintaining a challenge. We operationalize the framework using large language models as simulated readers, and define reference-less evaluation metrics for surprise, coherence, and fair play. Experiments on LLM-generated stories validate our theoretical predictions: while models generally succeed in creating surprise or coherence, achieving fair play poses a challenge even for strong models. Moreover, surprise and coherence do not positively correlate across stories, resisting reduction to a single latent quality. A human study validates the metrics, confirming they capture aspects of narrative quality that matter to readers. Our metrics also reproduce established literary intuitions, finding Christie's stories more surprising and more fair-playing than Conan Doyle's.

叙事生成公平解谜大模型评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。