arXiv:2506.00580cs.LGstat.ML2025-06

将慢特征分析重新解释为变分推断目标,突破线性限制。

Slow Feature Analysis as Variational Inference Objective

  • 用变分推断框架重释慢特征的优化目标
  • 慢度目标可看作重建损失的正则化项
  • 为非线性慢特征分析提供新思路,适合对理论建模感兴趣者

本文从变分推断视角提出慢特征分析(SFA)的新概率解释。与以往基于线性状态空间模型和线性观测的线性SFA推导不同,该方法放松了线性约束。虽然未实现与非线性SFA的完全等价,但成功将经典慢度目标重构为变分框架下的形式。具体而言,慢度目标被解释为对重建损失的正则化项。此外,我们论证了从慢度优化角度,重建损失起到了保证特征信息量的关键约束作用。最后讨论了潜在的新研究方向。

原文摘要 · Abstract (English)

This work presents a novel probabilistic interpretation of Slow Feature Analysis (SFA) through the lens of variational inference. Unlike prior formulations that recover linear SFA from Gaussian state-space models with linear emissions, this approach relaxes the key constraint of linearity. While it does not lead to full equivalence to non-linear SFA, it recasts the classical slowness objective in a variational framework. Specifically, it allows the slowness objective to be interpreted as a regularizer to a reconstruction loss. Furthermore, we provide arguments, why -- from the perspective of slowness optimization -- the reconstruction loss takes on the role of the constraints that ensure informativeness in SFA. We conclude with a discussion of potential new research directions.

慢特征分析变分推断概率建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。