用48张图训练出高精度箭靶定位系统,仅用380万参数即可实现毫米级精度。
Frozen Vision Transformers for Dense Prediction on Small Datasets: A Case Study in Arrow Localization

- 用颜色校正和冻结的DINOv3模型,结合引导上采样恢复亚毫米级空间精度。
- 在仅48张图上达到0.893的平均F1分数和1.41毫米的定位误差。
- 适合小样本密集预测任务,尤其适用于体育量化分析场景。
我们提出一个自动化系统,用于在40厘米室内箭靶上检测、定位并评分箭矢击中点,仅使用48张标注照片(共5,084个击中点)进行训练。该流程包含三个部分:基于颜色的标准化校正阶段,将透视扭曲图像映射到物理坐标系;冻结的自监督视觉变压器(DINOv3 ViT-L/16)与AnyUp引导特征上采样结合,从32×32块标记中恢复亚毫米级空间精度;以及轻量级CenterNet风格的检测头,用于预测箭中心热力图。全模型仅380万参数可训练(总参数3.08亿)。跨三折交叉验证下,平均F1得分为0.893±0.011,平均定位误差为1.41±0.06毫米,优于或媲美需大量数据的全监督方法。消融实验表明,通常用于亚像素优化的CenterNet偏移回归头在此设置下提升微弱且反而降低定位性能,说明引导上采样已有效弥补块标记带来的精度损失。在下游箭术指标上,系统对每幅图像的平均得分估计中位误差为1.8%,群体质心位置定位中位误差为4.00毫米。结果表明,冻结基础模型配合极简任务适配,是小数据密集预测的有效范式。
原文摘要 · Abstract (English)
We present a system for automated detection, localization, and scoring of arrow punctures on 40\,cm indoor archery target faces, trained on only 48 annotated photographs (5{,}084 punctures). Our pipeline combines three components: a color-based canonical rectification stage that maps perspective-distorted photographs into a standardized coordinate system where pixel distances correspond to known physical measurements; a frozen self-supervised vision transformer (DINOv3 ViT-L/16) paired with AnyUp guided feature upsampling to recover sub-millimeter spatial precision from $32 \times 32$ patch tokens; and lightweight CenterNet-style detection heads for arrow-center heatmap prediction. Only 3.8\,M of 308\,M total parameters are trainable. Across three cross-validation folds, we achieve a mean F1 score of $0.893 \pm 0.011$ and a mean localization error of $1.41 \pm 0.06$\,mm, comparable to or better than prior fully-supervised approaches that require substantially more training data. An ablation study shows that the CenterNet offset regression head, typically essential for sub-pixel refinement, provides negligible detection improvement while degrading localization in our setting. This suggests that guided feature upsampling already resolves the spatial precision lost through patch tokenization. On downstream archery metrics, the system recovers per-image average arrow scores with a median error of 1.8\% and group centroid positions to within a median of 4.00\,mm. These results demonstrate that frozen foundation models with minimal task-specific adaptation offer a practical paradigm for dense prediction in small-data regimes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。