让普通分类器学会看时间变化,无需改结构
Learning Time in Static Classifiers
- 用时序轨迹+软DTW损失,让分类器学时间动态
- 在细粒度分类和视频异常检测上显著提效
- 只需预提取特征,适合快速集成到现有系统
现实视觉数据很少是孤立静态的,通常随姿态、光照、物体状态或场景上下文渐变演化。但传统分类器假设时间独立性,难以捕捉此类动态。本文提出一种简单有效的框架,仅通过损失设计,即可为标准前馈分类器注入时间推理能力,无需修改模型结构或引入循环模块。核心是支持-样例-查询(SEQ)学习范式,将训练数据组织为时序连贯的轨迹。这些轨迹使模型能学习类特定的时间原型,并通过可微分软DTW损失对齐预测序列。多目标损失进一步促进语义一致性和时间平滑性。通过将输入序列视为演化特征轨迹,本方法仅靠损失设计就引入强时间归纳偏置。在静态与时序任务中均表现优异:显著提升细粒度与超细粒度图像分类性能,在视频异常检测中实现精确且时序一致的预测。尽管方法简单,却以模块化、数据高效的方式连接静态与时序学习,仅需在预提取特征上加一个简单分类器。
原文摘要 · Abstract (English)
Real-world visual data rarely presents as isolated, static instances. Instead, it often evolves gradually over time through variations in pose, lighting, object state, or scene context. However, conventional classifiers are typically trained under the assumption of temporal independence, limiting their ability to capture such dynamics. We propose a simple yet effective framework that equips standard feedforward classifiers with temporal reasoning, all without modifying model architectures or introducing recurrent modules. At the heart of our approach is a novel Support-Exemplar-Query (SEQ) learning paradigm, which structures training data into temporally coherent trajectories. These trajectories enable the model to learn class-specific temporal prototypes and align prediction sequences via a differentiable soft-DTW loss. A multi-term objective further promotes semantic consistency and temporal smoothness. By interpreting input sequences as evolving feature trajectories, our method introduces a strong temporal inductive bias through loss design alone. This proves highly effective in both static and temporal tasks: it enhances performance on fine-grained and ultra-fine-grained image classification, and delivers precise, temporally consistent predictions in video anomaly detection. Despite its simplicity, our approach bridges static and temporal learning in a modular and data-efficient manner, requiring only a simple classifier on top of pre-extracted features.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。