不靠迭代优化,用聚类引导混合生成高效视频压缩数据集
Efficient Video Dataset Distillation via Cluster-Guided Prototype Blending

- 通过聚类引导选择关键时间片段并分配到不同类别原型
- 在4个基准上实现与优化方法相当的准确率,且无需反复调整样本
- 适合追求高效训练数据压缩的研究者或工业落地场景
视频数据集蒸馏旨在将大型视频数据集压缩为紧凑的代理集以保留其训练价值。现有方法多通过迭代优化合成压缩视频,其成本因时间维度而加剧。本文探索是否可在不进行存储视频的梯度优化的前提下构建有效蒸馏视频。为此提出ProtoBlend框架:首先,基于教师模型引导选择高置信度的时间片段;其次,基于聚类的原型分配在教师特征空间中划分选定片段,并为每个类内聚类分配一个蒸馏槽位;最后,每个原型与聚类锚点混合,其教师预测采用相同系数融合,提供混合源监督。在四个修剪动作识别基准上的实验表明,ProtoBlend在无需对蒸馏视频进行迭代优化的情况下,实现了具有竞争力的准确率-效率权衡。
原文摘要 · Abstract (English)
Video dataset distillation aims to compress a large video dataset into a compact surrogate set that preserves its training utility. Most existing approaches synthesize condensed videos through iterative optimization, whose cost is amplified by the temporal dimension. Rather than further reducing the number of optimized variables, we investigate whether effective distilled videos can be constructed without gradient-based optimization of the stored videos. Such a construction-based approach must address three challenges: selecting informative temporal segments, covering diverse intra-class variations under a limited videos-per-class budget, and increasing the information carried by each stored sample. To this end, we propose ProtoBlend, an efficient select-allocate-blend framework. First, teacher-guided temporal clip selection retains a high-confidence segment from each source video. Second, cluster-guided prototype allocation partitions the selected clips in the teacher feature space and assigns one distilled slot to each intra-class cluster. Third, each prototype is blended with an in-cluster anchor, while their teacher predictions are combined using the same coefficient to provide mixture-source supervision. Experiments on four trimmed action-recognition benchmarks demonstrate that ProtoBlend achieves a competitive accuracy-efficiency trade-off without iterative optimization of the distilled videos.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。