arXiv:2604.15173cs.CV2026-04

聚焦动作边界,用少量标注实现精准时序动作分割

Boundary-Centric Clip-Budgeted Active Learning for Temporal Action Segmentation

论文配图:Boundary-Centric Clip-Budgeted Active Learning for Temporal Action Segmentation
图 1 · 摘自论文原文
  • 按边界重要性筛选待标注视频帧,优先标注易错区域
  • 在有限标注预算下,边界中心策略使准确率提升2.1~4.3个点
  • 适合标注成本敏感、对边界精度要求高的时序动作任务

未剪辑视频中的时序动作分割(TAS)需要密集的时间标注。然而,大部分标注成本集中在动作边界区域,这些区域的微小时间偏移会显著降低分割指标。本文提出B-ACT,一种基于片段预算的主动学习框架,专门将监督注意力集中于易出错的边界区域。B-ACT采用分层双阶段循环:(i) 基于预测不确定性排序并查询未标注视频;(ii) 在选定视频中,从模型预测中检测候选边界,并通过新颖的边界评分选择前-K个关键帧。该评分融合局部不确定性、类别模糊性和时间预测动态,揭示帧的重要程度。重要的是,标注仅需在边界帧进行,但训练时使用以边界为中心的片段,利用模型感受野保留时间上下文。在GTEA、50Salads和Breakfast数据集上的实验表明,边界中心标注在稀疏预算下显著优于现有主动学习基线和最先进方法,尤其在编辑距离和重叠率衡量的F1值敏感数据集上增益最大,提升达2.1~4.3个百分点。

原文摘要 · Abstract (English)

Temporal action segmentation (TAS) in untrimmed videos requires dense temporal supervision. However, most of the annotation cost is spent identifying action transitions where segmentation errors concentrate and small temporal shifts can disproportionately degrade segment-level metrics. We introduce B-ACT, a clip-budgeted active learning framework that explicitly allocates supervision to these error-prone boundary regions. B-ACT operates in a hierarchical two-stage loop: (i) it ranks and queries unlabeled videos using predictive uncertainty, and (ii) within each selected video, it detects candidate transitions from the current model predictions and selects the top-$K$ boundaries via a novel boundary score. The boundary score fuses neighborhood uncertainty, class ambiguity, and temporal prediction dynamics to reveal the underlying importance of each frame. Importantly, our annotation protocol requests labels only at the boundary frames while still training on boundary-centered clips to exploit temporal context through the model's receptive field. Extensive experiments on GTEA, 50Salads, and Breakfast demonstrate that boundary-centric supervision delivers strong label efficiency and consistently surpasses representative TAS active learning baselines and prior state of the art under sparse budgets. Gains are largest on datasets where performance is highly sensitive to boundary placement, as measured by edit and overlap-based F1 metrics.

时序分割主动学习边界检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。