arXiv:2511.20086cs.CL2025-11中稿 · the 41st ACM/SIGAP…被引 2

通过引导模型分析所有选项,提升多选题推理能力

More Bias, Less Bias: BiasPrompting for Enhanced Multiple-Choice Question Answering

  • 让模型为每个选项生成理由,再综合判断最优解
  • 在5个主流数据集上显著提升准确率,尤其在难题上表现突出
  • 适合需要深度推理的考试类任务或复杂问答场景

随着大语言模型(LLMs)的发展,其在多选题(MCQ)任务上的表现显著提升。然而,现有方法存在关键局限:答案选项通常未提供上下文支撑或解释,导致模型无法充分探索所有可能选项,削弱了推理能力。为此,我们提出BiasPrompting,一种新型推理框架,引导LLM在最终预测前为所有合理选项生成并批判性评估推理过程。该框架包含两个阶段:首先,在推理生成阶段,模型被提示为每个选项生成支持性理由;其次,在推理引导一致阶段,将生成的理由整合以选择最合理的答案。在五个广泛使用的多选题问答基准上的全面评估表明,BiasPrompting实现了显著性能提升。实验显示,该方法增强了LLM的推理能力,为解决复杂和具有挑战性的题目提供了坚实基础,尤其在现有方法表现不佳的场景中效果明显。

原文摘要 · Abstract (English)

With the advancement of large language models (LLMs), their performance on multiple-choice question (MCQ) tasks has improved significantly. However, existing approaches face key limitations: answer choices are typically presented to LLMs without contextual grounding or explanation. This absence of context can lead to incomplete exploration of all possible answers, ultimately degrading the models' reasoning capabilities. To address these challenges, we introduce BiasPrompting, a novel inference framework that guides LLMs to generate and critically evaluate reasoning across all plausible answer options before reaching a final prediction. It consists of two components: first, a reasoning generation stage, where the model is prompted to produce supportive reasonings for each answer option, and then, a reasoning-guided agreement stage, where the generated reasonings are synthesized to select the most plausible answer. Through comprehensive evaluations, BiasPrompting demonstrates significant improvements in five widely used multiple-choice question answering benchmarks. Our experiments showcase that BiasPrompting enhances the reasoning capabilities of LLMs and provides a strong foundation for tackling complex and challenging questions, particularly in settings where existing methods underperform.

多选题推理增强提示工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。