arXiv:2602.22702cs.AI2026-02

用物理控制理论让神经网络可调可控,操作者像拧旋钮一样实时调节模型稳定性。

Knob: A Physics-Inspired Gating Interface for Interpretable and Controllable Neural Dynamics

  • 将神经门控建模为二阶机械系统,用阻尼比和固有频率调控模型行为。
  • 在连续输入流中实现状态保持推理,响应符合经典控制理论特征。
  • 提供直观的物理化调节界面,适合需要人机协同的动态场景应用。

现有神经网络校准方法常将其视为静态、事后优化任务,忽略了真实推理中的动态与时间特性。同时缺乏直观接口供操作者在条件变化时动态调整模型行为。本文提出Knob框架,通过将神经门控动力学映射为二阶机械系统,建立阻尼比(ζ)与固有频率(ω_n)等物理参数与神经门控之间的对应关系,构建可调的‘安全阀’。核心机制采用对数空间凸融合,作为输入自适应温度缩放,当不同分支预测冲突时自动降低模型置信度。通过引入二阶动力学(Knob-ODE),实现双模式推理:标准独立同分布处理用于静态任务,状态保持处理用于连续数据流。实验在CIFAR-10-C上验证了校准机制有效性,并表明在连续模式下,门控响应符合典型的二阶控制特征(阶跃响应收敛与低通衰减),为可预测的人机协同调参奠定基础。

原文摘要 · Abstract (English)

Existing neural network calibration methods often treat calibration as a static, post-hoc optimization task. However, this neglects the dynamic and temporal nature of real-world inference. Moreover, existing methods do not provide an intuitive interface enabling human operators to dynamically adjust model behavior under shifting conditions. In this work, we propose Knob, a framework that connects deep learning with classical control theory by mapping neural gating dynamics to a second-order mechanical system. By establishing correspondences between physical parameters -- damping ratio ($ζ$) and natural frequency ($ω_n$) -- and neural gating, we create a tunable "safety valve". The core mechanism employs a logit-level convex fusion, functioning as an input-adaptive temperature scaling. It tends to reduce model confidence particularly when model branches produce conflicting predictions. Furthermore, by imposing second-order dynamics (Knob-ODE), we enable a \textit{dual-mode} inference: standard i.i.d. processing for static tasks, and state-preserving processing for continuous streams. Our framework allows operators to tune "stability" and "sensitivity" through familiar physical analogues. This paper presents an exploratory architectural interface; we focus on demonstrating the concept and validating its control-theoretic properties rather than claiming state-of-the-art calibration performance. Experiments on CIFAR-10-C validate the calibration mechanism and demonstrate that, in Continuous Mode, the gate responses are consistent with standard second-order control signatures (step settling and low-pass attenuation), paving the way for predictable human-in-the-loop tuning.

神经网络控制理论可解释性动态调节

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。