arXiv:2605.06017cs.LGmath.PR2026-05

提出新不等式框架,解决大模型长文本生成的稳定性难题

Matrix-Decoupled Concentration for Autoregressive Sequences: Dimension-Free Guarantees for Sparse Long-Context Rewards

  • 构建基于因果依赖矩阵的新型浓度不等式,精准捕捉序列相关性
  • 在稀疏奖励场景下实现恒定方差界,突破传统方法的O(N)上限
  • 适用于长上下文推理,为大模型稳定性提供数学保障

自回归大语言模型的序列级评估依赖高度相关的词元生成。现有框架面临两大瓶颈:(i) 经典不等式将依赖结构与目标敏感度分离,导致标量坍缩,使稀疏终端奖励的方差代理项膨胀至次优的$\mathcal{O}(N)$;(ii) 部分空间方法虽得更紧界,但缺乏自回归生成所需的严格因果滤波,难以适用。为此,本文建立一种针对依赖序列的尖锐McDiarmid型不等式,其由因果依赖解耦矩阵与目标敏感度向量的精确矩阵-向量乘积决定。该矩阵解耦浓度(MDC)框架天然恢复马尔可夫链的最优常数,并利用有向$d$-分离机制,对因果树实现阶最优界。关键在于,在严格因果框架内精确保持奖励的坐标稀疏性,避免标量坍缩,确保维度无关的$\mathcal{O}(1)$方差代理,为长上下文推理的稳定性提供了严谨数学解释。

原文摘要 · Abstract (English)

Sequence-level evaluations in autoregressive Large Language Models (LLMs) rely on highly dependent token generation. Establishing tight concentration bounds for these processes remains a challenge due to two fundamental bottlenecks in existing frameworks: (i) classical inequalities typically separate dependency structures from target sensitivities, leading to a scalar collapse that inflates the variance proxy to a suboptimal $\mathcal{O}(N)$ for sparse terminal rewards; (ii) conversely, while certain spatial methods achieve tighter bounds, they lack the strictly causal filtration required by sequential generation, rendering them inapplicable to the autoregressive setting. To resolve both bottlenecks, we establish a sharp McDiarmid-type inequality for dependent sequences, governed strictly by the exact matrix-vector multiplication of the causal dependency resolvent and the target sensitivity vector. This Matrix-Decoupled Concentration (MDC) framework natively recovers optimal constants for Markov chains and exploits directed $d$-separation to yield order-optimal bounds for causal trees. Crucially, by exactly preserving the coordinate-wise sparsity of rewards within a strictly causal framework, MDC mathematically prevents scalar collapse, guaranteeing a dimension-free $\mathcal{O}(1)$ variance proxy and providing a rigorous mathematical justification for the stability of long-context reasoning.

大模型推理概率不等式长序列建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。