用大模型标注法语文学中的希腊罗马神话引用，效果不错但需警惕幻觉。
Annotating References to Mythological Entities in French Literature
- 直接用大模型按自建规范标注神话引用，基本可行。
- 模型能准确识别约85%的神话实体引用，但偶有误判。
- 适合研究文学中的神话隐喻，但需人工核验生成内容。
本文探讨大型语言模型（LLMs）在现代与当代法语文学中标注希腊罗马神话实体引用的适用性。我们提出一种标注方案，并证明近期大模型可有效遵循该方案，尽管偶尔会出现显著分析错误。此外，大模型（尤其是ChatGPT）具备提供作者使用神话引用的阐释性见解的能力。然而，我们也发现，当作为信息检索工具使用时，模型难以准确识别小说中的相关段落，常产生幻觉并虚构示例，引发重大伦理问题。尽管如此，只要谨慎使用，大模型仍是实现大规模高精度标注的宝贵工具，尤其适用于人工无法全面完成的任务。
原文摘要 · Abstract (English)
In this paper, we explore the relevance of large language models (LLMs) for annotating references to Roman and Greek mythological entities in modern and contemporary French literature. We present an annotation scheme and demonstrate that recent LLMs can be directly applied to follow this scheme effectively, although not without occasionally making significant analytical errors. Additionally, we show that LLMs (and, more specifically, ChatGPT) are capable of offering interpretative insights into the use of mythological references by literary authors. However, we also find that LLMs struggle to accurately identify relevant passages in novels (when used as an information retrieval engine), often hallucinating and generating fabricated examples-an issue that raises significant ethical concerns. Nonetheless, when used carefully, LLMs remain valuable tools for performing annotations with high accuracy, especially for tasks that would be difficult to annotate comprehensively on a large scale through manual methods alone.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。