用大模型生成故事预期,精准预测读者期待和参与度。
Modeling Story Expectations: A Generative Framework using LLMs
- 用预训练大模型生成多种故事延续,提取情感与叙事路径等可解释特征。
- 在实验室和在线平台数据中,模型预测的期待与真人反馈及实际情节高度吻合。
- 适合内容创作者、平台方及叙事媒体研究者使用,可规模化建模读者心理。
消费者对故事的参与度受其对未来情节预期的影响,但如何在非结构化叙事内容上建模这种前瞻信念仍具挑战。本文提出一种基于大语言模型的生成框架,通过预训练模型生成多个想象中的故事延续,并从中提取可解释、理论驱动的特征,如情感变化与叙事路径。设计了两种互补验证方法:基于调查的方法将模型生成的预期与人类报告信念对比;理性预期法则将其与真实故事发展结果比较。在实验室控制环境与在线阅读平台的观测数据上应用该框架,结果显示模型生成的预期在所有分析特征上均与人类报告信念及实际情节发展高度相关。在两种场景中,前瞻性预期均能独立提升读者参与度,超越已消费内容的特征影响。该框架为规模化建模叙事内容中的消费者信念提供了可行方案,对内容创作、平台策略及叙事媒体研究具有重要意义。
原文摘要 · Abstract (English)
Consumers' engagement with stories is shaped by their expectations about what will happen next, yet modeling these forward-looking beliefs over unstructured narrative content has remained challenging. We develop a framework that uses large language models to approximate consumers' story expectations. Our method generates multiple imagined story continuations from a pre-trained LLM and extracts interpretable, theory-motivated features from these continuations, such as emotion and narrative path features. We propose two complementary validation procedures suited to different data availability: a survey-based approach that compares LLM-derived expectations to human-reported beliefs, and a rational-expectations approach that compares them to actual story outcomes. Applying the framework to both survey data collected in a controlled lab setting and observational data from an online reading platform, we find that LLM-derived expectations correlate with human-reported beliefs as well as actual story continuations along all features studied. In both settings, forward-looking expectations are associated with reader engagement above and beyond features of the content already consumed. Our framework provides a scalable method for modeling consumer beliefs about narrative content, with implications for content creation, platform strategy, and the study of narrative media.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。