首个高山滑雪动作评分细粒度数据集,让模型像裁判一样精准打分。
FineSkiing: A Fine-grained Benchmark for Skiing Action Quality Assessment
- 分阶段分析视频,结合关键区域感知提升评分准确性。
- 引入判罚项先验知识,使评分更贴近真实裁判逻辑。
- 适用于体育动作评估、智能裁判系统研发人员。
动作质量评估(AQA)旨在量化体育动作水平,近年受到广泛关注。现有方法多基于全视频特征预测分数,可解释性与可靠性不足;同时现有数据集缺乏针对扣分项和子项的细粒度标注。本文构建了首个包含空中滑雪动作细粒度子分与扣分项标注的AQA数据集,并发布为新基准。针对技术挑战,提出名为JudgeMind的新方法:将动作视频分阶段处理,逐段评分以提高精度;设计阶段感知特征增强与融合模块,强化对各阶段关键部位的感知,提升对频繁视角变化的鲁棒性;并引入基于知识的等级感知解码器,融合可能的扣分项作为先验知识,实现更准确可靠的评分。实验表明,该方法达到当前最优性能。
原文摘要 · Abstract (English)
Action Quality Assessment (AQA) aims to evaluate and score sports actions, which has attracted widespread interest in recent years. Existing AQA methods primarily predict scores based on features extracted from the entire video, resulting in limited interpretability and reliability. Meanwhile, existing AQA datasets also lack fine-grained annotations for action scores, especially for deduction items and sub-score annotations. In this paper, we construct the first AQA dataset containing fine-grained sub-score and deduction annotations for aerial skiing, which will be released as a new benchmark. For the technical challenges, we propose a novel AQA method, named JudgeMind, which significantly enhances performance and reliability by simulating the judgment and scoring mindset of professional referees. Our method segments the input action video into different stages and scores each stage to enhance accuracy. Then, we propose a stage-aware feature enhancement and fusion module to boost the perception of stage-specific key regions and enhance the robustness to visual changes caused by frequent camera viewpoints switching. In addition, we propose a knowledge-based grade-aware decoder to incorporate possible deduction items as prior knowledge to predict more accurate and reliable scores. Experimental results demonstrate that our method achieves state-of-the-art performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。