arXiv:2602.03157cs.CV2026-02中稿 · Computer Vision an…

用户交互式优化运动视频检索,无需标注即可提升精准度。

Human-in-the-loop Adaptation in Group Activity Feature Learning for Team Sports Video Retrieval

  • 自监督预训练构建活动特征空间,不依赖人工标签。
  • 用户仅标记少量视频,即可通过对比学习优化检索结果。
  • 在两个团队运动数据集上显著提升检索性能,适合体育视频应用。

本文提出一种无群体活动标注的人机协同适应方法,用于改进群体活动特征学习(GAFL)的视频检索性能。与以往需预先定义类别并进行监督学习的方法不同,本方法首先通过自监督方式基于群体活动相似性预训练特征空间。随后引入人机交互微调流程:系统从数据库中筛选若干视频供用户手动标记为正例或负例,利用这些标注更新特征空间,使正样本更接近查询视频、负样本更远离。实验在两个团队运动数据集上验证了该方法的有效性,消融研究也表明各模块对性能提升均有贡献。代码已开源。

原文摘要 · Abstract (English)

This paper proposes human-in-the-loop adaptation for Group Activity Feature Learning (GAFL) without group activity annotations. This human-in-the-loop adaptation is employed in a group-activity video retrieval framework to improve its retrieval performance. Our method initially pre-trains the GAF space based on the similarity of group activities in a self-supervised manner, unlike prior work that classifies videos into pre-defined group activity classes in a supervised learning manner. Our interactive fine-tuning process updates the GAF space to allow a user to better retrieve videos similar to query videos given by the user. In this fine-tuning, our proposed data-efficient video selection process provides several videos, which are selected from a video database, to the user in order to manually label these videos as positive or negative. These labeled videos are used to update (i.e., fine-tune) the GAF space, so that the positive and negative videos move closer to and farther away from the query videos through contrastive learning. Our comprehensive experimental results on two team sports datasets validate that our method significantly improves the retrieval performance. Ablation studies also demonstrate that several components in our human-in-the-loop adaptation contribute to the improvement of the retrieval performance. Code: https://github.com/chihina/GAFL-FINE-CVIU.

视频检索人机交互自监督运动分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。