arXiv:2603.23420cs.AI2026-03被引 4

让自动研究自我优化,实现搜索效率5倍提升。

Bilevel Autoresearch: Meta-Autoresearching Itself

  • 外层自动研究动态分析内层代码与运行轨迹,实时注入优化机制。
  • 在GPT预训练基准上,外层优化使验证比特率降低至-0.045(原为-0.009)。
  • 无需人工设计,自动从组合优化等领域复用搜索策略,适合研究智能体自我进化者。

若自动研究本身是一种研究,则可将其应用于研究过程本身。我们提出双层自动研究(Bilevel Autoresearch),其中外层自动研究循环通过读取内层循环的代码和运行轨迹,识别瓶颈并实时生成可注入的Python搜索机制。内层循环优化任务性能,外层循环优化内层的搜索方式。两者使用同一LLM,因此改进来自双层架构而非更强的元模型,尽管外层增加了推理和实际时间开销。在Karpathy的GPT预训练基准上,元自动研究外层相比标准内层循环实现5倍改进(验证比特率-0.045对比-0.009);仅参数调整而无机制变化则无可靠增益。外层循环从相邻搜索领域(如组合优化、多臂赌博机、实验设计)自动实例化机制,无需人工指定最终设计。轨迹分析表明,这些机制打破确定性搜索模式,迫使模型探索其先验避免的方向。实验首次展示了双层优化:外层提升了内层的搜索行为。本实现中代码是机制载体,但技能、提示、工作流、评估器、领域原则、世界模型假设和记忆结构也可编码机制,塑造未来代理行为。这为递归自举提供了路径:内层发现的机制可反馈用于改进元层自身。

原文摘要 · Abstract (English)

If autoresearch is itself a form of research, then autoresearch can be applied to research itself. We present Bilevel Autoresearch, a bilevel framework in which an outer autoresearch loop improves an inner autoresearch loop by reading its code and traces, identifying bottlenecks, and generating injectable Python search mechanisms at runtime. The inner loop optimizes task performance; the outer loop optimizes how the inner loop searches. Both loops use the same LLM, so improvements come from the bilevel architecture rather than a stronger meta-level model, although the outer loop consumes additional inference and wall-clock budget. On Karpathy's GPT pretraining benchmark, the meta-autoresearch outer loop achieves a 5x improvement over the standard inner loop alone (-0.045 vs. -0.009 val_bpb), while parameter-level adjustment without mechanism change yields no reliable gain. The outer loop instantiates mechanisms from adjacent search domains, including combinatorial optimization, multi-armed bandits, and design of experiments, without human specification of the final mechanism design. Trace analysis suggests that these mechanisms break deterministic search patterns and force exploration of directions the LLM's priors avoid. The experiments demonstrate, on this benchmark, a first bilevel step: an outer loop improves the search behavior of an inner loop. Code is the mechanism carrier in this implementation, but skills, prompts, workflows, evaluators, domain principles, world-model assumptions, and memory schemas can also encode mechanisms that shape future agent behavior. This suggests a path toward recursive bootstrapping, where mechanisms discovered for the inner loop can be fed back to improve the meta-level loop itself.

自动研究双层优化搜索机制自我进化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。