arXiv:2607.02915cs.LGcs.AI2026-07

一种高效全局搜索框架,能根据反馈动态调整采样策略。

Bootstrap Flow-Map Tree Sampling Enables Online Feedback Driven Search

论文配图:Bootstrap Flow-Map Tree Sampling Enables Online Feedback Driven Search
图 1 · 摘自论文原文
  • 基于树结构的采样框架,单次评估即可构建完整路径。
  • 在有限预算下实现从全局探索到局部精修的平滑过渡。
  • 适合偏好未知、需通过反馈逐步发现高价值区域的任务。

在诸多科学与工程领域中,受限于采样预算,如何战略性地引导探索以最大化发现至关重要。尽管生成模型已实现无需训练的奖励对齐,但现有方法通常仅擅长在分布狭窄区域内进行局部搜索。当偏好事先未知,仅能通过序列反馈揭示时,亟需广泛探索以发现高价值区域。为此,我们提出Bootstrap Flow-Map-Tree(BFMT),一种计算高效的采样框架,可在采样预算约束下实现历史感知的全局搜索与对齐。BFMT仅需一次函数评估即可完成任意深度的树路径构建,显著降低计算开销,并提供关键的前瞻能力以支持序列采样。通过动态调度采样时间步,BFMT可高效分配预算,平稳实现从广域全局探索到已发现高价值模式的精细局部优化。在多样化的搜索与对齐任务中,大量实验与消融分析表明,BFMT显著优于基线方法。

原文摘要 · Abstract (English)

In many scientific and engineering domains, maximizing discovery within a limited sampling budget demands strategic, observation-guided exploration. While generative models have enabled training-free reward alignment, current methods typically excel in local searches within narrow regions of the underlying distribution. These approaches struggle when preferences are unknown a priori and only revealed through sequential feedback-a scenario demanding broad exploration to uncover high-utility regions. To address this, we introduce Bootstrap Flow-Map-Tree (a.k.a BFMT), a novel computationally efficient sampling framework designed for history-aware global search and alignment under sampling budget constraints. BFMT enables full tree-path construction from any tree depth using a single function evaluation, drastically reducing computational overhead while providing critical foresight for sequential sampling. By enabling dynamic transition time steps scheduling, BFMT efficiently allocates its sampling budget, smoothly transitioning from broad global exploration to fine-grained local refinement of high-utility modes discovered through exploration. Extensive experiments and ablations across diverse search and alignment tasks demonstrate that BFMT substantially outperforms baseline approaches.

采样优化序列反馈全局搜索预算约束

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。