通信新范式:用预测状态减少传输,只传差异信息。
Predictive-State Communication: Innovation Coding and Reconciliation under Delay
- 发送方和接收方共享预测状态,仅传输修正差异的创新信息。
- 在延迟约束下,可用容量与感知连续性共同决定通信可行性带宽。
- 适合大模型等具备强预测能力的场景,如生成式通信系统。
香农理论将通信视为符号序列的可靠传输,性能受容量和率失真极限约束。当两端均具备强大预测能力(如现代大语言模型及生成先验)时,字面意义上的符号传输不再是唯一可行方式。本文提出预测状态通信(PSC),即收发双方维护显式共享的预测状态,物理信道主要用于传递创新信息——即纠正接收方临时轨迹与发送方实际轨迹之间偏差的信息。该视角以模型不匹配下的交叉熵替代熵率计算,并引入依赖于容量、延迟和感知连续性要求的可行性约束;由此形成的运行集通常是一个有界感知-容量带,而非单边阈值。文章概述了协议与架构影响(状态标识符、锚点、有限回滚、基于补丁的更新),并通过简化示例可视化诱导的可行性区域及其对预测质量的依赖关系。
原文摘要 · Abstract (English)
Shannon theory models communication as the reliable transfer of symbol sequences, with performance governed by capacity and rate-distortion limits. When both endpoints possess strong predictors -- as in modern large language models and related generative priors -- literal symbol transport is no longer the only operational regime. We propose predictive-state communication (PSC), in which the transmitter and receiver maintain an explicit shared predictive state, and the physical channel is used primarily to convey innovations, i.e., corrective information that reconciles the receiver's provisional trajectory with the transmitter's realized trajectory. This viewpoint replaces entropy-rate accounting by cross-entropy accounting under model mismatch, and it introduces feasibility constraints that depend jointly on capacity, delay, and perceptual continuity requirements; the resulting operating set is typically a bounded perception-capacity band rather than a one-sided threshold. We outline the protocol and architectural implications (state identifiers, anchors, bounded rollback, and patch-based updates) and provide a stylized illustrative example to visualize the induced feasibility region and its dependence on predictive quality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。