用弱标注训练旋转目标检测,省去繁琐的旋转框标注
Wholly-WOOD: Wholly Leveraging Diversified-quality Labels for Weakly-supervised Oriented Object Detection
- 统一利用点、水平框、旋转框等不同质量标签
- 仅用水平框训练,性能接近旋转框训练模型
- 适合遥感等领域,大幅降低标注成本
准确估计视觉对象的方位并用紧凑的旋转边界框(RBoxes)表示已成为重要需求,挑战了仅使用水平边界框(HBoxes)的传统检测范式。为使检测器具备方位感知能力,现有方法需依赖昂贵的旋转标注。然而,部分现有数据集仅提供水平框甚至单点标注。如何有效利用这些弱标注训练旋转目标检测器(OOD)成为开放问题。本文提出Wholly-WOOD框架,能统一利用点、水平框、旋转框及其组合等多种标注形式。仅使用水平框进行训练,其性能已非常接近使用旋转框训练的模型,在遥感及其他领域表现优异,显著减少对耗时的人工旋转标注依赖。源代码已开源(PyTorch和Jittor版本)。
原文摘要 · Abstract (English)
Accurately estimating the orientation of visual objects with compact rotated bounding boxes (RBoxes) has become a prominent demand, which challenges existing object detection paradigms that only use horizontal bounding boxes (HBoxes). To equip the detectors with orientation awareness, supervised regression/classification modules have been introduced at the high cost of rotation annotation. Meanwhile, some existing datasets with oriented objects are already annotated with horizontal boxes or even single points. It becomes attractive yet remains open for effectively utilizing weaker single point and horizontal annotations to train an oriented object detector (OOD). We develop Wholly-WOOD, a weakly-supervised OOD framework, capable of wholly leveraging various labeling forms (Points, HBoxes, RBoxes, and their combination) in a unified fashion. By only using HBox for training, our Wholly-WOOD achieves performance very close to that of the RBox-trained counterpart on remote sensing and other areas, significantly reducing the tedious efforts on labor-intensive annotation for oriented objects. The source codes are available at https://github.com/VisionXLab/whollywood (PyTorch-based) and https://github.com/VisionXLab/whollywood-jittor (Jittor-based).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。