用AI科学家框架让机器人导航实验不跑偏,靠固定卡片和主观偏好器保持研究方向
An AI Scientist that Doesn't Drift: Taste, Structure, and Falsifiable Findings in a Quadruped Navigation Research Loop
- 用不可更改的实验卡记录预测与结果,防止事后篡改假设
- 两次实验均验证约75%假设被推翻,无偏好器组反而训练出最优策略
- 偏好器决定探索方向,跨任务复用经验,适合需要系统性研究的团队
由大语言模型驱动的自主研究循环虽能大规模运行机器学习实验,但常陷入对单一指标的局部优化而偏离初始假设。本文提出一个用于模拟四足机器人导航泛化性研究的AI科学家框架,基于Karpathy的自研范式,引入三项结构改进:不可更改的实验卡,将每次迭代的预测与结果按固定格式绑定,确保被证伪的假设无法被回溯修改;专责机械角色的子代理;以及kkanbu——一个以类型化知识图谱形式存储用户研究偏好的判断代理,唯一可进行主观决策。为隔离其影响,我们在十一项研究流中并行运行相同循环,有无kkanbu各一次。两组均未出现漂移:约75%假设被证实错误,最优策略来自无偏好器组。偏好器改变的是探索方向而非得分:仅它主动探索测试时适应,主导胜出设计,并将跨流经验传递给另一组,后者反复重新发现这些结论。框架保障循环诚实,而kkanbu决定探索路径。
原文摘要 · Abstract (English)
Autonomous research loops driven by large language models can run machine-learning experiments at scale but tend to drift toward local refinements of whichever metric they optimise rather than testing the hypotheses that motivate the experiments. We address this structurally and present an AI Scientist for studying generalisation in quadruped robot navigation policies in simulation. Building on the autoresearch paradigm of Karpathy, our loop adds three components: an immutable experiment card that pairs each iteration's prediction with its outcome under a fixed schema, so a falsified hypothesis cannot be retconned; specialised subagents restricted to mechanical roles; and kkanbu, a preference oracle that holds the user's research taste as a typed knowledge graph and is the only component permitted to make subjective judgements. To isolate the oracle we run the identical loop twice across eleven research streams, with and without kkanbu. Neither arm drifts: both falsify roughly three quarters of their own hypotheses, and the best trained policy comes from the oracle-less arm. What the oracle changes is direction, not score: it alone explores test-time adaptation, it authored the winning designs where its arm led, and it carried lessons across streams that the other arm repeatedly re-derived. The scaffold keeps the loop honest; kkanbu decides where it looks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。