arXiv:2606.15741cs.CLcs.AI2026-06

通过多答案一致性筛选,提升叙事问答的准确性和鲁棒性。

A Self Consistency Based Reranking for Narrative Question Answering

论文配图:A Self Consistency Based Reranking for Narrative Question Answering
图 1 · 摘自论文原文
  • 生成多个候选答案,基于语义一致性选择最优解
  • 在NarrativeQA上,最高提升达14.57个百分点
  • 无需修改模型结构,适配各类预训练模型

叙事问答(NQA)是自然语言处理中的挑战性任务,要求模型理解长文本上下文、捕捉事件间关系并生成连贯回答。尽管预训练语言模型取得进展,现有方法多依赖单次解码输出,易受生成波动影响,常导致答案不完整或不一致。为此,我们提出一种基于自一致性重排的叙事问答框架。该方法为每个故事-问题对生成多个候选答案,并基于生成结果间的语义一致性选择最终答案,从而在不修改底层架构的前提下,通过共识机制提升鲁棒性。框架结合预训练与微调的语言生成模型,采用多答案推理与相似度重排策略。在NarrativeQA数据集上,使用FLAN-T5(Base和Small)及Pegasus-Large等模型进行评估,结果表明该方法在所有模型上均持续提升性能。其中,FLAN-T5-Base从82.32%提升至86.66%(+4.34%),而Pegasus-Large提升最为显著,从72.50%增至87.07%(+14.57%),验证了该策略的有效性。

原文摘要 · Abstract (English)

Narrative question answering (NQA) is a challenging task in natural language processing that requires models to understand long textual contexts, capture relationships across events, and generate coherent responses. Despite recent advances in pretrained language models, most existing approaches rely on a single decoding output during inference, making them sensitive to generation variability and often resulting in incomplete or inconsistent answers .To address this limitation, we propose a self-ensemble Self-Consistency-Based reranking framework for narrative question answering. The proposed method generates multiple candidate answers for each story-question pair and selects the final answer based on semantic agreement among the generated responses. This allows the model to explore diverse answer formulations while improving robustness through consensus-based selection without requiring modifications to the underlying architecture .The framework combines pretrained and fine-tuned language generation with multi-answer inference and similarity-based reranking. We evaluate the proposed approach on the NarrativeQA dataset using multiple models, including FLAN-T5 (Base and Small) and Pegasus-Large, under both baseline and fine-tuned settings .Experimental results demonstrate that the proposed method consistently improves performance across all models. In particular, FLAN-T5-Base achieves the best overall performance, improving from 82.32% to 86.66% (+4.34%) when combined with self-ensemble inference. Additionally, the largest improvement is observed with Pegasus-Large, which increases from 72.50% to 87.07% (+14.57%), highlighting the effectiveness of the proposed strategy.

叙事问答自一致性重排序语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。