提出新方法降低动态数据漂移下的模型风险,提升长期部署稳定性。
Jacobian-Velocity Bounds for Deployment Risk Under Covariate Drift
- 通过雅可比-速度定理控制部署路径中的风险波动,聚焦漂移方向的敏感性。
- 在低秩漂移下,风险主要由漂移子空间内的雅可比能量决定,可被有效抑制。
- 适用于长期冻结预测模型的场景,尤其适合数据漂移方向已知或可估计的任务。
我们研究冻结预测器在动态协变量漂移下的长期部署风险。时间域Poincaré不等式将时序风险波动简化为导数能量;雅可比-速度定理进一步提供路径级控制。在显式正则性和支配性假设下,该定理指出部署路径上的方向切向能量是主导量。在低秩漂移下,此量退化为漂移子空间内的方向雅可比能量,从而启发了漂移对齐切向正则化(DTR)及匹配监控代理。与各向同性平滑不同,DTR仅惩罚沿估计漂移方向的敏感性。我们在四个实验中验证了从理论到方法的完整流程:一个合成基准验证时间域不等式,一个受控合成对比实验评估各向同性雅可比正则化,以及两个基于UCI空气质量数据集和Tetouan电力消耗数据集的真实冻结部署研究。DTR在受控低秩环境下降低了风险波动与方向增益,并优于各向同性平滑。在两个真实数据集上,其均取得验证选择的部署收益,其中空气质量数据的漂移子空间由目标正交传感器运动估计得出。中等漂移子空间误设仍可容忍,而正交误设则基本消除优势。
原文摘要 · Abstract (English)
We study long-horizon deployment of a frozen predictor under dynamic covariate shift. A time-domain Poincare inequality first reduces temporal risk volatility to derivative energy. A Jacobian-velocity theorem then supplies the corresponding pathwise control. Given explicit regularity and domination assumptions, the theorem identifies directional tangent energy along the deployment path as the governing quantity. Under low-rank drift, that quantity reduces to directional Jacobian energy in the drift subspace, motivating drift-aligned tangent regularization (DTR) and a matched monitoring proxy. Rather than smoothing the network isotropically, DTR penalizes sensitivity only along estimated drift directions. We validate the theorem-to-method pipeline in four experiments: a synthetic benchmark for the time-domain inequality, a controlled synthetic comparison against isotropic Jacobian regularization, and two frozen-deployment studies on the UCI Air Quality and Tetouan power-consumption datasets. DTR reduces risk volatility and directional gain in the controlled low-rank regime and beats isotropic smoothing there. It also gives validation-selected deployment gains on both real datasets, with the Air Quality subspace estimated from target-orthogonal sensor motion. Moderate drift-subspace misspecification is tolerable while orthogonal misspecification largely removes the benefit.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。