对比分解与迭代执行两种编程生成方法,发现后者更贴近真实解法。
Shedding Light in Task Decomposition in Program Synthesis: The Driving Force of the Synthesizer Model
- 用迭代执行驱动生成,不依赖显式任务分解
- 在多种任务中表现接近或超过传统分解方法
- 揭示重复执行对程序求解的关键作用
任务分解是程序合成中的核心机制,将复杂问题拆解为可管理的子任务。ExeDec作为先进框架,结合子目标模型进行分解和合成器模型生成代码,以实现组合泛化。本文提出REGISM,是ExeDec的改进版本,移除分解引导,仅依赖迭代执行驱动的合成。通过对比ExeDec(采用分解)与REGISM(不依赖分解),我们研究二者在程序生成中的相互作用。结果表明,ExeDec在长度泛化和概念组合任务中具有显著优势,可能源于其明确的分解策略;而REGISM在多数场景下表现相当甚至更优,且生成解更贴近真实分解路径。这说明重复执行驱动的合成在提升任务求解性能方面至关重要,即使在包含显式分解的框架中也如此。分析提示,如ExeDec等分解方法仍有巨大潜力,但需进一步明确其适用条件与原因。
原文摘要 · Abstract (English)
Task decomposition is a fundamental mechanism in program synthesis, enabling complex problems to be broken down into manageable subtasks. ExeDec, a state-of-the-art program synthesis framework, employs this approach by combining a Subgoal Model for decomposition and a Synthesizer Model for program generation to facilitate compositional generalization. In this work, we develop REGISM, an adaptation of ExeDec that removes decomposition guidance and relies solely on iterative execution-driven synthesis. By comparing these two exemplary approaches-ExeDec, which leverages task decomposition, and REGISM, which does not-we investigate the interplay between task decomposition and program generation. Our findings indicate that ExeDec exhibits significant advantages in length generalization and concept composition tasks, likely due to its explicit decomposition strategies. At the same time, REGISM frequently matches or surpasses ExeDec's performance across various scenarios, with its solutions often aligning more closely with ground truth decompositions. These observations highlight the importance of repeated execution-guided synthesis in driving task-solving performance, even within frameworks that incorporate explicit decomposition strategies. Our analysis suggests that task decomposition approaches like ExeDec hold significant potential for advancing program synthesis, though further work is needed to clarify when and why these strategies are most effective.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。