arXiv:2605.09316quant-phcs.AI2026-05

用信息因果律约束表示学习,让模型只通过中间接口响应查询。

Neural Information Causality

论文配图:Neural Information Causality
图 1 · 摘自论文原文
  • 强制查询分离,使表示成为可通信的消息而非普通特征
  • 揭示了信息瓶颈的容量限制与量子增强的本质边界
  • 适合研究模型记忆、泄漏与通信效率的理论分析

查询分离计算迫使表示发挥操作性作用:数据在查询出现前编码,解码器只能通过中间接口回答。在此设定下,表示充当消息而非单纯特征映射。我们通过将信息因果律(IC)嵌入表示学习,提出神经信息因果律(Neural-IC)框架。该框架区分两个逻辑独立命题:第一,所有查询分离结构均构成随机访问通信实验,并满足嵌入不等式 $I_{\mathrm{N\text{-}RAC}}\le I(\vec a:H,B)$;第二,任何独立验证的物理容量限制,如硬 $m$-比特字母表、有限精度寄存器或功率受限噪声信道,均导出 $I_{\mathrm{N\text{-}RAC}}\le C_H$。此分离避免将容量视为事后定义,使Neural-IC成为检测查询泄漏、精度泄漏和特定时段记忆的运行诊断工具。我们提供一个精确的一比特经典RAC基准,明确指出量子增强并非超越瓶颈的总信息,而是公平的查询条件访问。对于CHSH型相关层,嵌套的Neural-RAC协议在深度上累积相关偏差;要求任意深度下一比特瓶颈的稳定性,即选择Tsirelson阈值。分析还扩展至非对称种子偏差、多容量有限深度相图及通过条件信息得分处理相关数据。受控模拟包括直通二值瓶颈和故意泄漏消融实验,验证看似违反现象均由查询分离失效或容量低估所致。

原文摘要 · Abstract (English)

Query-separated computation forces a representation to play an operational role: data are encoded before a query is known, and a later decoder can answer only through the intermediate interface. In this regime the representation functions as a message rather than merely as a feature map. We formalize this observation by embedding information causality (IC) into representation learning, obtaining a framework called neural information causality (Neural-IC). The revised formulation separates two logically distinct statements. First, every query-separated architecture induces a random-access communication experiment and obeys the embedding inequality $I_{\mathrm{N\text{-}RAC}}\le I(\vec a:H,B)$. Second, any independently certified physical capacity bound on the interface, such as a hard $m$-bit alphabet, a finite-precision register, or a power-constrained noisy channel, implies $I_{\mathrm{N\text{-}RAC}}\le C_H$. This separation avoids treating capacity as a post hoc definition and makes Neural-IC an operational diagnostic for query leakage, precision leakage, and episode-specific memory. We also provide an exact one-bit classical RAC benchmark, showing explicitly that the relevant quantum enhancement is not total information beyond the bottleneck, but fair query-conditioned access. For CHSH-type correlation layers, nested Neural-RAC protocols multiply correlation biases across depth; requiring stability of a one-bit bottleneck for arbitrary depth selects the Tsirelson threshold. We extend the analysis to asymmetric seed biases, to multi-capacity finite-depth phase diagrams, and to correlated data via a conditional information score. Controlled simulations, including straight-through binary bottlenecks and deliberately leaky ablations, verify that apparent violations are accounted for by broken query separation or undercounted capacity.

表示学习信息论量子优势

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。