arXiv:2505.17427cs.CL2025-05EMNLP被引 6

根据问题难易自动调节推理深度,既省算力又提准确率。

T$^2$: An Adaptive Test-Time Scaling Strategy for Contextual Question Answering

  • 基于问题结构动态选择推理策略,避免过度思考简单题。
  • 在7个基准上准确率超基线,算力消耗最多降低25.2%。
  • 适合需要高效推理的部署场景,如实时问答系统。

大型语言模型在上下文问答任务中表现优异,但现有方法对所有问题均采用复杂推理,缺乏适应性。高效测试时缩放方法虽引入预算或早停机制,却依赖人工设定且未发挥模型自身推理能力。为此,我们提出T²:Think-to-Think,一种基于问题复杂度动态调整推理深度的新框架。其核心思想是:若模型能用特定推理策略解决相似问题,则可复用该策略处理原问题。T²通过四步实现:分解问题结构、生成带候选策略的相似样本、多标准评估策略有效性、选择最优策略应用于原问题。在七个不同上下文问答基准上的实验表明,T²不仅准确率优于基线方法,且计算开销最多降低25.2%。

原文摘要 · Abstract (English)

Recent advances in Large Language Models (LLMs) have demonstrated remarkable performance in Contextual Question Answering (CQA). However, prior approaches typically employ elaborate reasoning strategies regardless of question complexity, leading to low adaptability. Recent efficient test-time scaling methods introduce budget constraints or early stop mechanisms to avoid overthinking for straightforward questions. But they add human bias to the reasoning process and fail to leverage models' inherent reasoning capabilities. To address these limitations, we present T$^2$: Think-to-Think, a novel framework that dynamically adapts reasoning depth based on question complexity. T$^2$ leverages the insight that if an LLM can effectively solve similar questions using specific reasoning strategies, it can apply the same strategy to the original question. This insight enables to adoption of concise reasoning for straightforward questions while maintaining detailed analysis for complex problems. T$^2$ works through four key steps: decomposing questions into structural elements, generating similar examples with candidate reasoning strategies, evaluating these strategies against multiple criteria, and applying the most appropriate strategy to the original question. Experimental evaluation across seven diverse CQA benchmarks demonstrates that T$^2$ not only achieves higher accuracy than baseline methods but also reduces computational overhead by up to 25.2\%.

推理优化LLM应用自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。