arXiv:2501.07360cs.CVcs.LG2025-01中稿 · Winter Conference …被引 11

构建首个大规模木材组件数据集,实现林区自动作业中树木的精准分割与追踪。

TimberVision: A Multi-Task Dataset and Framework for Log-Component Segmentation and Tracking in Autonomous Forestry Operations

  • 基于2000+张标注图像,构建51000个木材部件数据集。
  • 提出融合检测与分割结果的统一树干表征框架,提升复杂环境下的鲁棒性。
  • 适用于自动化伐木、运输等场景,可兼容多传感器系统。

木材是日益重要且多用途的资源,但采伐、搬运和测量等林业作业仍严重依赖人力,尤其在偏远地区存在重大安全风险。逐步实现这些任务的自动化可提升效率与安全性,但需精准识别单个原木及活树及其上下文。尽管已有初步探索,该领域仍缺乏专用数据与算法。为此,我们提出TimberVision数据集,包含超过2000张标注的RGB图像,共51000个树干部件(含截断面与侧表面),在规模与细节上远超现有数据集。基于此数据,我们开展定向目标检测与实例分割的消融实验,评估多种场景参数对模型性能的影响。提出一个通用框架,将检测与分割结果融合为统一的树干表示,并自动推导几何属性,结合多目标追踪进一步增强鲁棒性。所提方法仅用RGB图像即可在复杂环境下生成高度描述性且准确的树干表示,适用于多种应用场景,可轻松集成其他传感器模态。

原文摘要 · Abstract (English)

Timber represents an increasingly valuable and versatile resource. However, forestry operations such as harvesting, handling and measuring logs still require substantial human labor in remote environments posing significant safety risks. Progressively automating these tasks has the potential of increasing their efficiency as well as safety, but requires an accurate detection of individual logs as well as live trees and their context. Although initial approaches have been proposed for this challenging application domain, specialized data and algorithms are still too scarce to develop robust solutions. To mitigate this gap, we introduce the TimberVision dataset, consisting of more than 2k annotated RGB images containing a total of 51k trunk components including cut and lateral surfaces, thereby surpassing any existing dataset in this domain in terms of both quantity and detail by a large margin. Based on this data, we conduct a series of ablation experiments for oriented object detection and instance segmentation and evaluate the influence of multiple scene parameters on model performance. We introduce a generic framework to fuse the components detected by our models for both tasks into unified trunk representations. Furthermore, we automatically derive geometric properties and apply multi-object tracking to further enhance robustness. Our detection and tracking approach provides highly descriptive and accurate trunk representations solely from RGB image data, even under challenging environmental conditions. Our solution is suitable for a wide range of application scenarios and can be readily combined with other sensor modalities.

林业自动化目标分割多目标追踪视觉感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。