通过真实反馈循环提升模型推理,突破传统计算资源限制。
Interaction Scaling: Grounding the Third Axis of Test-Time Compute

- 引入交互式迭代:模型提出方案,外部工具观测并反馈真实结果
- 在固定算力下,交互策略持续提升表现,最佳达100%通过率且无波动
- 需真实观测与真实评分双接地,否则效果失效,适合高可靠性任务
测试时增加计算量通常依赖延长推理或多次采样,但二者均受限于模型自身权重和提示,无法获取新知识。本文提出第三种方式——交互:模型生成产物,外部工具观察其实际行为,再由模型修正。每轮引入真实观测,突破前两种方法的瓶颈。研究发现,该机制的核心变量是‘接地性’,即反馈与评估必须来自真实观测。在固定令牌预算下,仅靠推理或采样均趋于饱和(即使使用理想选择器),而所有交互策略持续改进;所提提案-评审框架在硬编码任务中实现100%通过率且无运行间方差,跨三大模型家族有效。在可视化产物中,常规判别器(视觉语言模型)因截图掩盖缺陷,误评14/15个明显错误为“完美”;而基于真实布局测量的工具显示,该循环可消除40%-74%缺陷,覆盖四种模态;同一视觉语言模型作为评审者反而使幻灯片布局恶化,反证测量工具的重要性。交互扩展真实存在且独立于推理与采样,但仅当反馈与评估均接地时才显现。
原文摘要 · Abstract (English)
There are two standard ways to spend more compute at test time: let a model reason longer, or sample more attempts and keep one. Both share a hidden limit: they are internal. Every extra token comes from the same frozen weights and the same prompt, so neither can tell the model anything it does not already know. We study a third way, interaction: the model proposes an artifact, an external instrument observes how it actually behaves, and the model revises. Each cycle imports a real observation, so interaction breaks through the ceiling the other two hit. We argue that a single variable governs this third axis, grounding, and that it must hold on both sides of the loop. The feedback that drives revision must come from an instrument that actually observes the flaw, and so must the metric that scores the result. On hard coding tasks at a fixed token budget, reasoning-only and best-of-N sampling both plateau (the latter even when an oracle picks the best sample), while every interaction strategy keeps improving; our proposer-reviewer harness reaches a perfect 100% pass rate with no run-to-run variance, and the gain holds across three model families. On rendered visual artifacts, the usual judge (a vision-language model, or VLM, reading a screenshot) rates 14 of 15 visibly broken figures "perfect," because the screenshot hides the flaws before the judge can see them. A tool that measures the real layout instead shows the loop removing 40-74% of defects across four modalities; and that same VLM, used as the reviewer, makes slide layouts worse where the measuring tool repairs them. Interaction scaling is real and distinct from reasoning and sampling, but only visible when both the feedback and the metric are grounded.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。