研究上下文学习在偏序关系中的可识别性与容量极限
Identifiability and Order-Dimension Limits of In-Context Learning on Partial Orders
- 提出偏序上下文学习的理论框架,区分逻辑可识别性与教学成本
- 证明查询结果三分类:必然为真、必然为假或仍模糊,基于正负例闭包
- 揭示偏序学习维度上限与结构复杂度关系,适合形式化推理研究者
上下文学习通常被形式化为从函数示例中进行推断。但偏序结合了传递性、反对称性和不可比性,因此有限提示可能无法确定查询比较。本文建立了偏序上下文学习的理论体系,分离了逻辑可识别性、提示教学成本、结构复杂度及形式坐标解码器类的精确容量。引入版本空间语义,明确背景知识与开世界/闭世界假设。对于包含正负比较的有限开世界提示,我们证明了精确完成三分类:在正例取自反传递闭包后,查询可能强制为真,或因任何真完成都会导致环路或违反负例而强制为假,或仍保持真正模糊。对已知n元素宇宙,我们刻画开世界教学数为覆盖数加阻塞集击中数,其最大值为n(n−1),且仅在反链时达到,并确认阻塞项即为开世界而非完整哈斯图语义的精确代价。我们形式化依赖提示的s坐标解码器,利用经典坐标-序等价关系,获得精确表示边界:维度至多为s是必要且充分条件,宽度至多为s是方便的充分条件。
原文摘要 · Abstract (English)
In-context learning is commonly formalized as inference from examples of a function. Partial orders instead combine transitivity, antisymmetry, and incomparability, so a finite prompt may not determine a queried comparison. We develop a theory of in-context learning on partial orders that separates logical identifiability, prompt teaching cost, structural complexity, and the exact capacity of a formal coordinate-decoder class. A version-space semantics makes background knowledge and open- versus closed-world assumptions explicit. For finite open-world prompts with positive and negative comparisons, we prove an exact completion trichotomy: after taking the reflexive transitive closure of the positive demonstrations, a query is forced true, forced false because every true completion creates a cycle or violates a negative demonstration, or remains genuinely ambiguous. For a known $n$-element universe, we characterize the open-world teaching number as the number of covers plus a blocker-set hitting number, prove that its maximum over all $n$-element posets is $n(n-1)$ and is uniquely attained by the antichain, and identify the blocker term as the exact cost of open-world rather than complete-Hasse semantics. We formalize prompt-dependent $s$-coordinate decoders and use the classical coordinate-order equivalence to obtain an exact representation boundary: dimension at most $s$ is necessary and sufficient, while width at most $s$ is a convenient sufficient condition.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。