arXiv:2509.05317cs.CVcs.AI2025-09

VILOD让目标检测标注更透明高效,人机协作可视化决策。

VILOD: A Visual Interactive Labeling Tool for Object Detection

  • 用t-SNE、热力图等可视化辅助人工标注决策
  • 不同策略下模型性能媲美自动不确定性采样
  • 适合希望提升标注效率的视觉算法研究者

深度学习推动目标检测发展,但高质量标注数据获取成本高、耗时长。主动学习虽可减少标注量,但缺乏透明性,易遗漏非策略匹配样本。为此,本文提出“VILOD:一种面向目标检测的可视化交互标注工具”,融合t-SNE图像特征投影、不确定性热力图与模型状态视图,支持用户在人机协同流程中探索数据、理解模型状态、分析主动学习建议,并灵活制定标注策略。通过对比实验验证,VILOD的可视化界面显著提升了模型状态与数据分布的可解释性(RQ1),且不同视觉引导策略下的标注结果在目标检测性能上可达到与自动不确定性采样基线相当的水平(RQ2)。该工作为提升目标检测标注中人机协同的透明度与效率提供了新工具与实证依据。

原文摘要 · Abstract (English)

The advancement of Object Detection (OD) using Deep Learning (DL) is often hindered by the significant challenge of acquiring large, accurately labeled datasets, a process that is time-consuming and expensive. While techniques like Active Learning (AL) can reduce annotation effort by intelligently querying informative samples, they often lack transparency, limit the strategic insight of human experts, and may overlook informative samples not aligned with an employed query strategy. To mitigate these issues, Human-in-the-Loop (HITL) approaches integrating human intelligence and intuition throughout the machine learning life-cycle have gained traction. Leveraging Visual Analytics (VA), effective interfaces can be created to facilitate this human-AI collaboration. This thesis explores the intersection of these fields by developing and investigating "VILOD: A Visual Interactive Labeling tool for Object Detection". VILOD utilizes components such as a t-SNE projection of image features, together with uncertainty heatmaps and model state views. Enabling users to explore data, interpret model states, AL suggestions, and implement diverse sample selection strategies within an iterative HITL workflow for OD. An empirical investigation using comparative use cases demonstrated how VILOD, through its interactive visualizations, facilitates the implementation of distinct labeling strategies by making the model's state and dataset characteristics more interpretable (RQ1). The study showed that different visually-guided labeling strategies employed within VILOD result in competitive OD performance trajectories compared to an automated uncertainty sampling AL baseline (RQ2). This work contributes a novel tool and empirical insight into making the HITL-AL workflow for OD annotation more transparent, manageable, and potentially more effective.

目标检测人机协同可视化标注

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。