用共享上下文窗口提升文学文本引语归属准确率与速度
Fast and Accurate Quotation Attribution in Literary Texts

- 采用联合评分机制,在大上下文窗口内同时处理多个引语归属
- 在35000+条引语上达到94.5%准确率,速度比标准方法快20倍
- 适合需要高效高精度文学分析的研究者与工具开发者
在文学文本中为引语确定说话人仍是一个开放挑战。传统方法独立预测每个引语的说话人,虽高效但准确率有限;而大型语言模型(LLM)方法虽性能强,但计算成本高,难以用于大规模文学分析。本文提出一种基于编码器的高效范式,通过共享大上下文窗口实现多个引语归属的联合建模。利用新提出的‘联合评分’方法,我们在包含超过35,000条人工标注引语的Project Dialogism Novel Corpus(PDNC)上取得当前最佳性能。最优模型在A100 GPU上处理小说的速度比同类标准方法快20倍,比基于LLM的方法快1000倍以上,整体归属准确率达94.5%。对模型表示的分析表明,联合评分能更好地保留长距离回指解析信号,该信息已在预训练编码器中存在。为促进应用,我们发布了ModernBookNLP,一个修改版BookNLP,已将引语归属模型替换为本研究的最佳系统,项目地址:https://github.com/gasmichel/ModernBookNLP_QA/
原文摘要 · Abstract (English)
Attributing quotations to their speakers in literary texts remains an open challenge. Standard methods, which independently predict a speaker mention for each quotation, are efficient but still limited in accuracy. In contrast, large language model (LLM) approaches achieve strong performance, but their computational cost limits their use in large-scale literary analysis. We propose an encoder-based efficient formulation that resolves multiple quotation attributions within a shared, large context window. Using our new formulation, \textit{joint scoring}, we report state-of-the-art (SOTA) performance on the Project Dialogism Novel Corpus (PDNC), comprising more than 35,000 manually annotated quotations from 22 English novels. Our best model reaches 94.5\% overall attribution accuracy while processing novels $20\times$ faster than comparable standard methods and more than $1000\times$ faster than LLM-based approaches on an A100 GPU. An analysis of models' representations suggests that joint scoring improves on challenging attribution examples by preserving long-range anaphora resolution signal, an information that we found already present in pretrained encoders. To facilitate adoption, we release ModernBookNLP, a modified fork of BookNLP that replaces its quotation attribution model with our best system available at https://github.com/gasmichel/ModernBookNLP_QA/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。