通过分离逻辑一致性和有效性,让低效但合理的思路成为探索资产。
Lateral Tree-of-Thoughts Surpasses ToT by Incorporating Logically-Consistent, Low-Utility Candidates
- 将候选路径分为高价值主干与低效但一致的侧枝,分别处理
- 用有限探查快速筛选侧枝,一旦达标立即晋升,避免浪费算力
- 适合需要大规模测试时推理、追求多样性和稳定性的场景
当前部署中越来越多地分配大量测试时计算资源(数千个标记或多次节点扩展)以提升可靠性。在此类预算下,标准的思维树搜索出现两种缺陷:宽度饱和(新增样本多为近似重复,宽度不再增长)和深度短视(短期噪声评估过早剪枝长期有回报的分支)。我们提出横向思维树(LToT),一种可直接替换的控制器,将效用与逻辑一致性解耦,将低效但一致的候选视为资产而非冗余。前沿被划分为主干(高价值候选用于利用)和侧枝(一致但初始低效候选,经短暂廉价探查后判断)。LToT 通过横向竞速-短路机制(LR--SC)探索侧枝:采用截断的逐次减半竞赛,将微小探查分散至极宽的侧枝集,使用宽度感知阈值并重复确认,一旦其表现突破主干阈值即刻晋升;主干保持狭窄,使多余算力投入在宽度成本低的区域。我们证明横向成本为伪线性 $Θ(N_0 \log_η N_0)$,而无限制主干呈指数增长(初始侧枝宽度 $N_0$,剔除因子 $η>1$)。基准任务上的实证评估正在准备,将在后续版本补充。总之,LToT 将大规模测试时预算转化为有原则的多样性,同时保留晋升纪律,缓解饱和与短视问题,且不增加额外算力。
原文摘要 · Abstract (English)
Modern deployments increasingly allocate large test-time compute (thousands of tokens or many node expansions) to boost reliability. Under such budgets, standard Tree-of-Thoughts-style search exhibits two pathologies: breadth saturation (additional samples mostly produce near-duplicates, so width stops growing) and depth myopia (noisy short-horizon utilities prune branches whose payoff appears after a few more steps). We propose Lateral Tree-of-Thoughts (LToT), a drop-in controller that separates utility from logical consistency and treats low-utility but consistent candidates as assets rather than waste. The frontier is split into mainlines (high-utility candidates used for exploitation) and laterals (consistent, initially low-utility candidates that receive short, cheap probes before judgment). LToT explores laterals via Lateral Racing with Short-Circuit (LR--SC): a capped successive-halving race that spreads tiny probes across a very wide lateral set, uses width-aware thresholds with repeat-to-confirm, and immediately promotes a branch once its envelope clears the mainline bar; mainlines are kept intentionally narrow so surplus compute is invested where width is cheap. We prove a pseudolinear lateral cost $Θ(N_0 \log_η N_0)$ with logarithmically many rungs (initial lateral width $N_0$; culling factor $η>1$), in contrast to the exponential growth of uncapped mainlines. Empirical evaluations on benchmark tasks are in preparation and will be added in a future revision. In short, LToT turns large test-time budgets into principled diversity while preserving promotion discipline, mitigating saturation and myopia without inflating compute.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。