arXiv:2603.19283cs.CL2026-03被引 1

首次实现《一千零一夜》中叙事母题的自动化索引,为文化文本分析提供新工具。

Automated Motif Indexing on the Arabian Nights

  • 基于《一千零一夜》与详细母题索引构建标注语料,训练模型识别母题表达
  • 微调的 Llama3 模型在母题检测上达 0.85 F1,优于关键词、嵌入和生成式方法
  • 适合民俗学、文化研究及文本挖掘领域,尤其关注叙事结构分析的研究者

母题是民间故事中非普遍但反复出现的叙事元素,也广泛存在于现代新闻、文学和宣传文本中。自动识别母题在民俗学分析(母题索引)与现代文本解读中具有重要意义。以往研究显示自动化处理难度大。本文提出首个计算化的母题索引方法,利用《一千零一夜》这一大型可获取文本与 El-Shamy(2006)的详尽母题索引,克服了文本不可得的问题。我们构建了人工标注语料,涵盖 58,450 句中的 2,670 个母题表达,涉及 200 种不同母题。测试了五类方法:(1)关键词检索+微调交叉编码器;(2)现成嵌入模型;(3)微调嵌入模型;(4)通用大模型在 N-shot 提示下的生成;(5)使用 LoRA 微调的大模型生成。最佳系统为微调的 Llama3,整体达到 0.85 F1。

原文摘要 · Abstract (English)

Motifs are non-commonplace, recurring narrative elements, often found originally in folk stories. In addition to being of interest to folklorists, motifs appear as metaphoric devices in modern news, literature, propaganda, and other cultural texts. Finding expressions of motifs in the original folkloristic text is useful for both folkloristic analysis (motif indexing) as well as for understanding the modern usage of motifs (motif detection and interpretation). Prior work has primarily shown how difficult these problems are to tackle using automated techniques. We present the first computational approach to motif indexing. Our choice of data is a key enabler: we use a large, widely available text (the Arabian Nights) paired with a detailed motif index (by El-Shamy in 2006), which overcomes the common problem of inaccessibility of texts referred to by the index. We created a manually annotated corpus that identified 2,670 motif expressions of 200 different motifs across 58,450 sentences for training and testing. We tested five types of approaches for detecting motif expressions given a motif index entry: (1) classic retrieve and re-rank using keywords and a fine-tuned cross-encoder; (2) off-the-shelf embedding models; (3) fine-tuned embedding models; (4) generative prompting of off-the-shelf LLMs in N-shot setups; and (5) the same generative approaches on LLMs fine-tuned with LoRA. Our best performing system is a fine-tuned Llama3 model which achieves an overall performance of 0.85 F1.

叙事分析母题识别大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。