提出动态判别分析框架,应对随时间变化的分布漂移问题。
A State-Space Approach to Nonstationary Discriminant Analysis
- 将判别分析嵌入状态空间模型,建模随时间变化的类别分布。
- 在模拟中优于传统LDA、QDA和SVM,对噪声和缺失数据鲁棒。
- 适用于时间分布漂移场景,如在线学习与异常检测。
经典判别分析假设训练数据同分布,但在许多实际应用中,观测随时间采集,类别条件分布会发生漂移,导致静态分类器失效。本文提出一种基于模型的统一框架,将判别分析融入状态空间模型,构建非平稳线性判别分析(NSLDA)与非平稳二次判别分析(NSQDA)。针对线性高斯动态,通过改进卡尔曼平滑处理每时刻多样本,并发展两种实用扩展:(i) 使用期望最大化(EM)联合估计未知系统参数;(ii) 结合高斯混合模型(GMM)与卡尔曼滤波,同时恢复隐含的时间标签与参数,这在实际中常见。对于非线性或非高斯漂移,采用粒子平滑估计时变类别中心,实现完全非平稳判别规则。大量模拟实验表明,该方法在噪声、缺失数据及类别不平衡条件下均显著优于静态LDA、QDA和支持向量机(SVM)基准。本文为时间分布偏移下的判别分析建立了统一且数据高效的理论基础。
原文摘要 · Abstract (English)
Classical discriminant analysis assumes identically distributed training data, yet in many applications observations are collected over time and the class-conditional distributions drift. This population drift renders stationary classifiers unreliable. We propose a principled, model-based framework that embeds discriminant analysis within state-space models to obtain nonstationary linear discriminant analysis (NSLDA) and nonstationary quadratic discriminant analysis (NSQDA). For linear-Gaussian dynamics, we adapt Kalman smoothing to handle multiple samples per time step and develop two practical extensions: (i) an expectation-maximization (EM) approach that jointly estimates unknown system parameters, and (ii) a Gaussian mixture model (GMM)-Kalman method that simultaneously recovers unobserved time labels and parameters, a scenario common in practice. To address nonlinear or non-Gaussian drift, we employ particle smoothing to estimate time-varying class centroids, yielding fully nonstationary discriminant rules. Extensive simulations demonstrate consistent improvements over stationary linear discriminant analysis (LDA), quadratic discriminant analysis (QDA), and support vector machine (SVM) baselines, with robustness to noise, missing data, and class imbalance. This paper establishes a unified and data-efficient foundation for discriminant analysis under temporal distribution shift.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。