构建短篇小说事件抽取数据集,提升文学文本事件识别效果
Enhancing Event Extraction from Short Stories through Contextualized Prompts
- 设计七类事件标注体系,聚焦儿童文学语境
- 提出提示学习方法,冲突类事件准确率提升超4%
- 为文学研究与NLP提供可复用的标注资源
事件抽取是自然语言处理中从非结构化文本中识别事件的重要任务。尽管已有大量研究聚焦新闻、临床文本等领域的事件抽取,但针对文学内容的研究仍较少。短篇小说中的事件识别面临挑战,包括事件分布不同于其他领域,以及情感状态表达多样。本文构建了名为 exttt{Vrittanta-EN} 的英文短篇小说数据集,包含1000篇主要面向儿童的印度语境故事,并提出了新的事件标注指南,将事件分为七类: exttt{COGNITIVE-MENTAL-STATE(CMS)}、 exttt{COMMUNICATION(COM)}、 exttt{CONFLICT(CON)}、 exttt{GENERAL-ACTIVITY(GA)}、 exttt{LIFE-EVENT(LE)}、 exttt{MOVEMENT(MOV)} 和 exttt{OTHERS(OTH)}。基于该指南对数据集进行标注后,我们评估了基线方法,并提出一种基于提示的方法用于事件检测与分类。实验表明,该方法优于基线模型,在 exttt{CONFLICT} 类事件分类任务上提升超过4%。
原文摘要 · Abstract (English)
Event extraction is an important natural language processing (NLP) task of identifying events in an unstructured text. Although a plethora of works deal with event extraction from new articles, clinical text etc., only a few works focus on event extraction from literary content. Detecting events in short stories presents several challenges to current systems, encompassing a different distribution of events as compared to other domains and the portrayal of diverse emotional conditions. This paper presents \texttt{Vrittanta-EN}, a collection of 1000 English short stories annotated for real events. Exploring this field could result in the creation of techniques and resources that support literary scholars in improving their effectiveness. This could simultaneously influence the field of Natural Language Processing. Our objective is to clarify the intricate idea of events in the context of short stories. Towards the objective, we collected 1,000 short stories written mostly for children in the Indian context. Further, we present fresh guidelines for annotating event mentions and their categories, organized into \textit{seven distinct classes}. The classes are {\tt{COGNITIVE-MENTAL-STATE(CMS), COMMUNICATION(COM), CONFLICT(CON), GENERAL-ACTIVITY(GA), LIFE-EVENT(LE), MOVEMENT(MOV), and OTHERS(OTH)}}. Subsequently, we apply these guidelines to annotate the short story dataset. Later, we apply the baseline methods for automatically detecting and categorizing events. We also propose a prompt-based method for event detection and classification. The proposed method outperforms the baselines, while having significant improvement of more than 4\% for the class \texttt{CONFLICT} in event classification task.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。