arXiv:2510.17922cs.CLcs.AI2025-10EMNLP被引 5

根据任务特点动态选分解策略,兼顾效果与成本。

Select-Then-Decompose: From Empirical Analysis to Adaptive Selection Strategy for Task Decomposition in Large Language Models

  • 先分析六类分解方法,再按任务特征选最优方案。
  • 在多基准测试中始终处于性能与成本的帕累托前沿。
  • 适合追求高效可靠推理的LLM应用开发者。

大语言模型在推理与规划方面表现卓越,推动了任务分解研究的兴起。现有方法多关注记忆、工具使用与反馈机制,在特定领域取得显著成效,但常忽略性能与成本之间的权衡。本文首先系统分析任务分解,提出六种分类体系;接着通过实证研究揭示三类影响因素:方法类别、任务特性及模型配置,获得三项关键洞察并总结出实用原则。基于此,提出Select-Then-Decompose策略,构建包含选择、执行与验证三个阶段的闭环求解流程。该策略根据任务特征动态选择最适分解方式,并通过验证模块提升结果可靠性。跨多个基准的全面评估显示,该方法始终位于帕累托前沿,实现性能与成本的最佳平衡。代码已公开于 https://github.com/summervvind/Select-Then-Decompose。

原文摘要 · Abstract (English)

Large language models (LLMs) have demonstrated remarkable reasoning and planning capabilities, driving extensive research into task decomposition. Existing task decomposition methods focus primarily on memory, tool usage, and feedback mechanisms, achieving notable success in specific domains, but they often overlook the trade-off between performance and cost. In this study, we first conduct a comprehensive investigation on task decomposition, identifying six categorization schemes. Then, we perform an empirical analysis of three factors that influence the performance and cost of task decomposition: categories of approaches, characteristics of tasks, and configuration of decomposition and execution models, uncovering three critical insights and summarizing a set of practical principles. Building on this analysis, we propose the Select-Then-Decompose strategy, which establishes a closed-loop problem-solving process composed of three stages: selection, execution, and verification. This strategy dynamically selects the most suitable decomposition approach based on task characteristics and enhances the reliability of the results through a verification module. Comprehensive evaluations across multiple benchmarks show that the Select-Then-Decompose consistently lies on the Pareto frontier, demonstrating an optimal balance between performance and cost. Our code is publicly available at https://github.com/summervvind/Select-Then-Decompose.

任务分解LLM推理策略优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。