提出新方法检测语言模型中是否存在真实交互,避免误判。
Activation-Space Order-Swap Geometry: A Site-Asymmetry Audit
- 通过无拟合的位点不对称审计,分离出真正的交互信号
- 93.7%的顺序交换效应可由单一干预解释,交互信号微弱
- 适用于检测模型内部交互,对研究者有实操指导价值
顺序依赖的激活统计常被当作交互证据,但可能受干预位置干扰。本文提出无拟合位点不对称审计方法。对二阶可微读出,开路径顺序交换分解为单次干预的加性响应与不含一阶及纯自曲率项的反对称二阶差分。在六种开放权重语言模型中,单次干预基线解释了84.3%-97.7%的括号范数(均值93.7%),而无交互自曲率项比修正残差大1.8-5.2倍。在三种模型中,修正残差在去混淆提示分割下通过通用交互零假设检验,两模型在配置鲁棒性后仍通过。已知正样本可恢复预设混合交互,位点分离测试改变基线占比,随机架构重现一阶行为。同一估计器迁移至非语言模型:11/12对比中训练残差低于固定高斯方向零假设(5/6 ViT-B/16,6/6 ResNet-50),验证可迁移性而非合并证据。贡献是可复用的测量标准:读取顺序交换向量前,先检查单次干预是否解释该向量;若能,则应构造二阶差分。
原文摘要 · Abstract (English)
Order-dependent activation statistics are often interpreted as evidence of interaction, but that interpretation can be confounded by where interventions enter the network. We introduce a no-fit site-asymmetry audit. For a twice-differentiable readout, the open-path order-swap decomposes into a canonical additive response measured by single interventions and an antisymmetrized second difference free of first-order and pure self-curvature terms to second order. Across six open-weight language-model families, the single-intervention baseline explains 84.3-97.7 percent of the bracket norm (mean 93.7 percent), while the no-interaction self-curvature term is 1.8-5.2 times larger than the corrected residual in the two families with the plus/minus injection split. The corrected residual clears a generic-interaction null in three of six families under a confound-free prompt split and two of six after configuration robustness. A known-positive surrogate recovers planted mixed interaction, while a matched site-separation test changes the baseline share and a random architecture reproduces the first-order regime. The same estimator transfers to released non-language references: trained residual fractions fall below a fixed Gaussian-direction null in 11/12 contrasts (5/6 ViT-B/16, 6/6 ResNet-50), a portability check rather than pooled evidence. The contribution is a reusable measurement criterion: run the single-intervention baseline before reading an order-swap vector as interaction or geometric structure; if it explains the vector, form the second difference instead. All claims are scoped to activation-space interventions at distinct sites; we do not claim that representation geometry is globally Abelian.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。