用注意力机制筛选视频关键片段,既保动作识别又隐去隐私信息。
From Pixels to Privacy: Temporally Consistent Video Anonymization via Token Pruning for Privacy Preserving Action Recognition
- 引入动作与隐私双分类令牌,通过注意力差异判断内容价值
- 保留前k个高价值时空管块,使识别准确率接近原始视频
- 适合需保护隐私的动作识别场景,如监控与医疗视频分析
大规模视频模型在安防、医疗和娱乐等领域显著提升了视频理解能力,但同时也因编码面部身份、种族、性别等敏感属性而加剧隐私风险。尽管图像匿名化研究较成熟,视频匿名化仍相对不足,尤其现代视频模型可利用时空运动模式作为生物特征标识。为此,本文提出一种基于注意力驱动的时空视频匿名化框架,通过系统解耦实用信息与隐私信息。核心思想是:视觉变换器(ViTs)中的注意力机制可被显式结构化以分离与动作相关的信息与隐私敏感内容。在此基础上,引入两个任务特异性分类令牌——动作CLS令牌与隐私CLS令牌,在共享变换器主干中学习互补表征,并对比其注意力分布,为每个时空管块计算效用-隐私得分,保留得分最高的前k个管块。该方法有选择地剪除以隐私线索为主导的管块,同时保留对动作识别至关重要的部分。大量实验表明,该方法在保持动作识别性能接近原始视频训练模型的同时,显著降低隐私泄露风险。结果表明,注意力驱动的时空剪枝为隐私保护视频分析提供了一种有效且原理清晰的解决方案。
原文摘要 · Abstract (English)
Recent advances in large-scale video models have significantly improved video understanding across domains such as surveillance, healthcare, and entertainment. However, these models also amplify privacy risks by encoding sensitive attributes, including facial identity, race, and gender. While image anonymization has been extensively studied, video anonymization remains relatively underexplored, even though modern video models can leverage spatiotemporal motion patterns as biometric identifiers. To address this challenge, we propose a novel attention-driven spatiotemporal video anonymization framework based on systematic disentanglement of utility and privacy features. Our key insight is that attention mechanisms in Vision Transformers (ViTs) can be explicitly structured to separate action-relevant information from privacy-sensitive content. Building on this insight, we introduce two task-specific classification tokens, an action CLS token and a privacy CLS token, that learn complementary representations within a shared Transformer backbone. We contrast their attention distributions to compute a utility-privacy score for each spatiotemporal tubelet, and keep the top-k tubelets with the highest scores. This selectively prunes tubelets dominated by privacy cues while preserving those most critical for action recognition. Extensive experiments demonstrate that our approach maintains action recognition performance comparable to models trained on raw videos, while substantially reducing privacy leakage. These results indicate that attention-driven spatiotemporal pruning offers an effective and principled solution for privacy-preserving video analytics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。