arXiv:2608.10438cs.AI2026-08

让扩散模型在推理时持续异步调用工具,提升效率与准确性。

Continuous Interaction Diffusion: A Diffusion-Native Runtime for Asynchronous Tool-Augmented Reasoning

  • 将工具调用融入迭代去噪过程,支持未完成序列的实时交互。
  • 可提前触发外部读取,结果动态更新认知状态,减少重复计算。
  • 适合需要频繁获取外部信息的复杂推理任务,尤其适配扩散语言模型。

大型语言模型越来越依赖外部工具获取最新信息、执行计算并与外界交互。自回归模型中,工具调用自然嵌入生成流程:模型发出工具调用,等待结果后继续生成。但扩散语言模型(dLLMs)通过并行反复精炼输出多个部分进行推理,这种停顿-恢复模式过于受限。它可能在推理未稳定时强制做出工具决策,延迟有用观察直到离散调用完成,并引入冗余精炼与工具执行,影响任务准确性和推理效率。我们提出连续交互扩散(CID),一种原生支持工具交互的扩散模型-运行时架构。CID分离出只读事实通道、由类型化认知张量表示的思想通道和显示通道。信息需求可在文本或JSON调用完全序列化前出现,允许感知绑定在去噪过程中启动外部读取。返回结果被投影到演化的思想状态,可修正先前认知和显示区域。持久绑定复用静态结果,按需刷新变化源。CID旨在更早暴露证据,将工具延迟与模型计算重叠,减少重复外部工作,并保留新证据到达后的有效计算。我们形式化了该架构、运行时与训练目标,并定义了任务质量与端到端效率的评估协议。本文首次聚焦只读工具,未做实证性能声明。

原文摘要 · Abstract (English)

Large language models increasingly rely on external tools to access up-to-date information, perform computation, and interact with the outside world. For autoregressive models, tool use naturally fits the generation process: the model emits a tool call, waits for the result, and then continues generating. Diffusion language models (dLLMs), however, reason by repeatedly refining many parts of their output in parallel, making this stop-and-resume interaction pattern unnecessarily restrictive. It can force tool decisions before the model's reasoning has stabilized, delay useful observations until a discrete call finishes, and introduce redundant refinement and tool execution, potentially hurting both task accuracy and inference efficiency. We introduce Continuous Interaction Diffusion (CID), a diffusion-native model--runtime architecture that integrates tool interaction into iterative denoising. CID separates a model-read-only fact channel, a thought channel represented by a Typed Cognitive Tensor, and a display channel. Information needs can emerge before a textual or JSON call is fully serialized, allowing perceptual bindings to launch external reads while denoising continues. Returned results are projected into the evolving thought state and can revise earlier cognition and display regions. Persistent bindings reuse static results without repeated external execution and refresh changing sources when needed. CID is designed to expose evidence earlier, overlap tool latency with model computation, reduce duplicate external work, and preserve useful computation after new evidence arrives. We formalize the architecture, runtime, and training objectives, and define an evaluation protocol for task quality and end-to-end efficiency. This first paper focuses on read-only tools and makes no empirical performance claims.

扩散模型工具调用推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。