构建多语言故事数据集,揭示大模型生成叙事的跨语言差异。
BIASEDTALES-ML: A Multilingual Dataset for Analyzing Narrative Attribute Distributions in LLM-Generated Stories

- 设计全排列提示框架,生成8种语言共约35万篇儿童故事。
- 发现不同语言下角色、场景、主题分布存在显著差异。
- 适合关注多语言AI安全与文化适配的研究者使用。
大型语言模型(LLMs)被广泛用于生成包括儿童故事在内的叙事内容,这类内容在社会与文化学习中具有重要作用。尽管对AI安全与对齐的关注日益增加,现有评估仍主要集中于英语,跨语言对齐行为的泛化研究仍显不足。本文提出BiasedTales-ML,一个涵盖八种类型学与文化多样性语言的大规模平行语料库,包含约35万篇由全排列提示设计生成的儿童故事。我们构建了结构化的生成-提取管道与多维分布分析框架,探究叙事属性在语言、模型与社会条件间的变异。分析显示,叙事生成模式存在显著跨语言差异,英语中的分布特征在其他语言中并不总能复现,尤其在低资源语言中更为明显。在叙事层面,我们识别出角色、场景与主题强调的重复性结构模式,其表现形式随语言语境而异。这些发现凸显了以英语为中心的评估在刻画多语言社会性叙事生成方面的局限性。我们公开数据集、代码与交互式可视化工具,以支持未来多语言叙事分析与评估研究。
原文摘要 · Abstract (English)
Large Language Models (LLMs) are increasingly used to generate narrative content, including children's stories, which play an important role in social and cultural learning. Despite growing interest in AI safety and alignment, most existing evaluations focus primarily on English, leaving the cross-lingual generalization of aligned behavior underexplored. In this work, we introduce BiasedTales-ML, a large-scale parallel corpus of approximately 350,000 children's stories generated across eight typologically and culturally diverse languages using a full-permutation prompting design. We propose a structured generator-extractor pipeline and a multi-dimensional distributional analysis framework to examine how narrative attributes vary across languages, models, and social conditions. Our analysis reveals substantial cross-lingual variability in narrative generation patterns, indicating that distributions observed in English do not always exhibit similar characteristics in other languages, particularly in lower-resource settings. At the narrative level, we identify recurring structural patterns involving character roles, settings, and thematic emphasis, which manifest differently across linguistic contexts. These findings highlight the limitations of English-centric evaluation for characterizing socially grounded narrative generation in multilingual settings. We release the dataset, code, and an interactive visualization tool to support future research on multilingual narrative analysis and evaluation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。