arXiv:2606.29091cs.LGcs.AI2026-06中稿 · ICML

表格基础模型无法仅靠数据值区分合法与违规状态,存在理论极限。

Statistically Indistinguishable, Operationally Distinct: A Formal Barrier for Tabular Foundation Models

  • 构建合法与违规数据对,使其统计分布几乎无法区分
  • 三种仅用数据值的模型准确率均达50%,逼近理论下限
  • 必须依赖规则审计才能实现完美分类,适合研究模型边界者

表格基础模型在无系统规则信息时,无法判断数据生成是否合规。本文提出操作图灵测试(OTT),构造出1-和2维列值边际分布差异小于0.02的合法与违规数据库状态对;根据Le Cam引理,任何仅基于数值的分类器其贝叶斯误差至少为0.49。三种仅使用数值的基线模型(XGBoost、TabICL、TabPFN)准确率恰好为0.50,预注册的双单侧检验(TOST)p值均小于0.002。原始行级访问无法提升性能,仅当引入基于规则的关系一致性验证时,分类准确率才显著提高;唯有获得七条可执行规则审计的分类器能达到1.00准确率。在三个包含100个状态的前沿大语言模型实验中,即使提供模式、触发源、规则表和状态文件,模型对最多2/50个合法状态正确判定;即便使用更高推理成本与SQL执行器的GPT-5.5,也未能识别任何合法状态。该现象在第二个具有不同规则结构的银行账本数据模式(跨行平衡、累积聚合)中重复出现。该限制源于可识别性问题,而非模型容量:不依赖操作性基础,规模、数据量与更丰富特征均无法突破此屏障。

原文摘要 · Abstract (English)

Tabular foundation models cannot reason about data produced by running systems without access to the rules that govern them. We make this statement falsifiable. The \emph{Operational Turing Test} (OTT) constructs pairs of legal and rule-violating database states whose $1$- and $2$-way column-value marginals match to a total variation of $<0.02$; Le~Cam's lemma then bounds any values-only classifier at $\geq0.49$ Bayes error. Three values-only baselines (XGBoost, TabICL, TabPFN) hit the bound exactly (accuracy $0.50$, pre-registered two one-sided tests (TOST) $p<0.002$), raw row-level access does not help, exposing relational value consistency closes most of the gap, and only a classifier fed by seven executable rule-derived audits reaches $1.00$ classification accuracy. In three matched $100$-state frontier large-language-model (LLM) runs, models given the schema, trigger source, rule tables, and state files classify at most $2/50$ legal states as LEGAL; GPT-5.5 accepts $0/50$ legal states even with higher reasoning effort and a Structured Query Language (SQL) executor. The access-ladder pattern also appears on a second schema with structurally distinct rule families (banking ledger: cross-row balance, cumulative aggregate). The barrier is identifiability, not capacity: scale, data, and richer features cannot cross it without operational grounding.

表格模型可解释性形式化界限模型评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。