arXiv:2606.02427math.NAcs.LG2026-06被引 1

用谱分析检测上下文学习中的算子模型是否真实复现了微分方程的局部动态机制。

Spectral Audit of In-Context Operator Networks

论文配图:Spectral Audit of In-Context Operator Networks
图 1 · 摘自论文原文
  • 通过雅可比矩阵投影到傅里叶模态,获取模型对局部算子的频域特征表征。
  • 发现预测误差低的模型仍存在高频退化、相位恢复错误等结构缺陷。
  • 适合研究神经算子稳定性、可解释性及训练数据一致性问题的研究者。

现有神经算子与上下文算子学习的评估主要依赖预测误差,但高精度输出未必意味着正确的局部动力学结构。模型可能在解上匹配,却表现出错误的敏感度、失真的频率响应、虚假的模态耦合或不稳定的切线行为。本文提出基于雅可比矩阵的谱审计框架,对固定提示下的网络输出关于查询函数求导,将结果视为学习到的切线算子。通过投影至傅里叶模态,获得局部谱表征,包括频率相关增益、相位结构和跨模态耦合。该审计补充标准预测指标,检验模型是否复现底层偏微分方程(PDE)算子的局部机制而非仅输出。在多个基准测试中,揭示了相位传输、粘性依赖阻尼、非线性模态耦合及反应-扩散稳定性结构等算子级现象。同时检测出被预测误差掩盖的失败,如高频退化、相位恢复错误与提示-算子不一致。损坏或内部矛盾的提示即使保持部分点预测准确,也会导致切线算子结构劣化。结果表明,预测准确性与局部算子保真度是独立属性。本框架还提供稳定性、敏感性和算子一致性诊断工具。

原文摘要 · Abstract (English)

Existing evaluations of neural operators and in-context operator learning rely primarily on prediction error, but accurate output prediction does not guarantee the correct local dynamical structure. A model may match solutions while exhibiting incorrect sensitivities, distorted frequency response, spurious mode coupling, or unstable tangent behavior. We introduce a Jacobian-based spectral audit for in-context operator learning. For a fixed prompt, we differentiate the network output with respect to the query function and view the resulting Jacobian as a learned tangent operator. Projecting it onto Fourier modes, we obtain a local spectral characterization of the inferred operator, including frequency-dependent gains, phase structure, and cross-mode coupling. The audit complements standard prediction metrics by testing whether the model reproduces local mechanisms of the underlying PDE operator rather than only outputs. Across benchmarks, the audit reveals distinct operator-level phenomena, including phase transport, viscosity-dependent damping, nonlinear mode coupling, and reaction--diffusion stability structure. It also detects failures partially hidden by prediction-error metrics, including high-frequency degradation, incorrect phase recovery, and prompt--operator inconsistencies. Corrupted or internally inconsistent prompts lead to degraded tangent-operator structure even when pointwise predictions remain partially accurate. Our results suggest that prediction accuracy and local operator fidelity are distinct properties of learned neural operators. Our framework also provides a diagnostic for stability, sensitivity, and operator consistency.

神经算子谱分析微分方程上下文学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。