arXiv:2603.21309cs.CV2026-03被引 7

用缓存个性化实现视频表情识别的低成本实时适应

Test-Time Adaptation via Cache Personalization for Facial Expression Recognition in Videos

  • 设计三类缓存:静态个性化、正样本、负样本,实现无梯度微调
  • 在三个数据集上显著优于现有方法,且计算开销极低
  • 适合部署于资源受限的实时表情识别场景

视频中的人脸表情识别需模型个性化以应对个体差异。视觉语言模型虽具强迁移能力,但在个体分布偏移下性能下降。测试时自适应(TTA)可缓解此问题,但现有方法依赖无监督参数优化,计算开销大。本文提出基于缓存个性化的测试时自适应(TTA-CaP),无需梯度、成本低。引入三类缓存:通过特征统计匹配构建的静态个性化缓存,积累可靠个体样本的正目标缓存,以及存储低置信度样本的负目标缓存。通过三门控机制控制更新,依据时间稳定性、置信度与静态缓存一致性,防止缓存污染。三者互补提供主体匹配的正负证据,支持鲁棒在线个性化。进一步融合嵌入表示,提升时序稳定的视频级预测。在BioVid、StressID和BAH数据集上,TTA-CaP在个体与环境偏移下均超越现有TTA方法,同时保持极低计算与内存开销。代码已公开。

原文摘要 · Abstract (English)

Facial expression recognition (FER) in videos requires model personalization to capture considerable variations across subjects. Vision-language models (VLMs) offer strong transfer to downstream tasks through image-text alignment, but their performance can degrade under inter-subject distribution shifts. Test-time adaptation (TTA) can mitigate this challenge. However, most state-of-the-art TTA methods rely on unsupervised parameter optimization, introducing computational overhead that is impractical in many real-world applications. This paper introduces TTA through Cache Personalization (TTA-CaP), a cache-based TTA method that enables cost-effective, gradient-free personalization of VLMs for video FER. Prior cache-based TTA methods rely solely on dynamic memories that store test samples, which can accumulate errors and drift because of noisy pseudo-labels. TTA-CaP instead introduces three complementary caches: a personalized static cache constructed through feature-statistics matching, a positive target cache that accumulates reliable subject-specific samples, and a negative target cache that stores low-confidence cases as negative samples. To prevent target-cache corruption, a tri-gate mechanism controls cache updates based on temporal stability, confidence, and consistency with the personalized static cache. Together, these caches provide complementary, subject-matched positive and negative evidence for robust online personalization. TTA-CaP further refines predictions by fusing embeddings, yielding representations that support temporally stable video-level predictions. Experiments on BioVid, StressID, and BAH show that TTA-CaP outperforms state-of-the-art TTA methods under subject-specific and environmental shifts while maintaining low computational and memory overhead. Our code is publicly available at https://github.com/MasoumehSharafi/TTA-CaP.

表情识别测试时自适应缓存机制视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。