提出因果优化交互计算框架,揭示优化器隐藏机制与干预可识别性。
Causal Optimizer Interaction Calculus: Hidden Geometric Relaxation and Identifiable Interventions
- 构建路径实现、莫比乌斯分解与实验识别分离的因果计算体系
- 在65维凸逻辑模型上验证,布尔效应与曲率积分一致至10^-11量级
- 适用于需精确干预分析的复杂优化场景,如神经网络训练审计
优化器实验在不唯一揭示隐藏机制的情况下观测算法配置响应。我们提出因果优化交互计算,分离路径实现、莫比乌斯分解与实验识别。在固定创新耦合下,所有有限时域创新驱动优化器均有行为最小路径实现。对任意有限效应支持与干预设计,关联算子提供完整观测度量、精确可识别性、严格商稳定性、保留预测及无噪声配置复杂度。平滑隐式松弛通过反向隐状态刚度生成交互。基于此结构定律,证明可观测读出传递定理:任意光滑更新或迹读出继承显式五项交互,源自一阶与二阶隐响应。不同于约化最优值,一般读出无普遍交互符号;其布尔效应为连续交互曲率的精确积分,可通过因子干预识别。推导出高斯商极小极大风险、精确置信集与检验、误设分解、认证下游决策与最优复现。在65维强凸逻辑模型的受控真实数据实验中验证了完整约化值链。布尔效应与独立积分曲率一致于4.21×10^-11,九个保留连续强度一致于8.88×10^-13。高斯试验达到预测覆盖率与功效,4,500个真实小批量样本拒绝二阶交互模型。神经迹审计提供补充证据,表明声明响应类在非凸训练中仍具信息量。
原文摘要 · Abstract (English)
Optimizer experiments observe responses to algorithmic configurations without uniquely revealing hidden mechanisms. We develop a causal optimizer interaction calculus that separates pathwise realization, Mobius decomposition, and experimental identification. Under a fixed innovation coupling, every finite-horizon innovation-driven optimizer admits a behaviorally minimal pathwise realization. For any finite effect support and intervention design, an incidence operator gives the complete observational gauge, exact identifiability, sharp quotient stability, held-out predictions, and exact noiseless configuration complexity. Smooth hidden relaxation generates interactions through inverse hidden-state stiffness. Building on this structural law, we prove an observable-readout transfer theorem: arbitrary smooth update or trace readouts inherit an explicit five-term interaction through first and second hidden responses. Unlike the reduced optimal value, a general readout has no universal interaction sign. Its Boolean effects remain exact integrals of continuous interaction curvature and can therefore be identified by factorial interventions. We also derive Gaussian quotient minimax risk, exact confidence sets and tests, misspecification decomposition, certified downstream decisions, and optimal replication. A controlled real-data experiment on a 65-dimensional strongly convex logistic model validates the complete reduced-value chain. Boolean effects and independently integrated curvature agree within 4.21e-11, while nine held-out continuous intensities agree within 8.88e-13. Gaussian campaigns attain the predicted coverage and power, and 4,500 real-minibatch observations reject an order-two interaction model. Neural trace audits provide complementary evidence that the declared response classes remain informative in nonconvex training.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。