研究AI查询的随机响应如何影响计算能力,揭示重复查询可提升准确性。
Computing with Stochastic Oracles in AI-Augmented Computation
- 用带随机响应的图灵机建模AI辅助计算过程
- 重复查询同一问题可使错误率按切尔诺夫速率指数下降
- 适合关注AI推理效率与响应机制的算法研究者
Stochastic-Oracle Turing Machine(SOTM)框架将AI增强计算建模为概率图灵机与响应服从上下文相关分布的预言机之间的交互。本文研究了两种预言机响应机制下SOTM的计算能力:缓存响应预言机对每个唯一查询仅返回一次响应并重复使用,而新鲜响应预言机每次调用均返回独立响应。在两种机制中,SOTM先基于输入和内部随机源生成首个查询,随后自适应地根据查询-响应记录生成后续查询或输出结果。缓存响应施加两个基于摘要的性能上限:由预言机隐状态诱导的摘要分布间总变差距离决定的正确识别上限,以及从摘要中可计算出的最佳输出期望得分构成的输出质量上限。新鲜响应可通过多次调用积累独立证据,突破这些上限。在二元单信息查询情形下,错误概率随调用次数以切尔诺夫速率指数下降;对于输出质量,当评分函数作为SOTM组成部分时,查询次数有界可确定阈值停止点;当采用二元候选输出模型时,多数表决放大界适用。结果揭示了响应复用、摘要信息及评分函数可用性如何共同决定SOTM的计算能力与令牌开销。
原文摘要 · Abstract (English)
The Stochastic-Oracle Turing Machine (SOTM) framework models AI-augmented computation as the interaction of a probabilistic Turing machine with an oracle whose responses are drawn from context-dependent distributions. This paper studies what an SOTM can achieve under two oracle-response schemes: in a cached-response oracle, each distinct query receives one response that is reused on later calls to the same query, while in a fresh-response oracle, each call returns an independent response. In both schemes, the SOTM first computes from its input and internal random source to generate its first query, then proceeds adaptively, computing from its query-response transcript (the record of queries issued and responses received) to generate each subsequent query or produce a final output. Cached responses impose two transcript-based ceilings on achievable performance: a correct-identification ceiling governed by the total variation distance between the transcript distributions induced by the hidden states of the oracle, and an output quality ceiling equal to the expected score of the best output the SOTM can compute from the transcript. Fresh responses can raise these ceilings by allowing repeated calls to accumulate independent evidence toward correct or high-quality outputs. In the binary single-informative-query case, the error probability decreases exponentially in the number of calls to the same query at the Chernoff rate. For output quality, query-count bounds characterize threshold stopping when the score function is incorporated as part of the SOTM, and majority-based amplification bounds characterize the binary candidate-output model when it is not. Together, the results identify how response reuse, transcript information, and access to the score function determine what an SOTM can compute and at what token cost.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。