用频域特征增强模型,精准分割森林中细长树干。
WaveInst: A Frequency-Domain Enhanced Network for Fine-Grained Thin Tree Trunk Extraction in Forest Scenes
- 引入频域特征补偿分支,融合多方向高频信息。
- 在幼苗数据上达到29.1的mAP,比现有方法高6.6点。
- 适合需要精细树干分割的林业与育种研究。
分析树木形态,尤其是树干和枝条提取,对遗传育种和林业管理具有重要意义。现有基于图像的深度学习方法在因前后重叠导致结构不连续时,容易将多个树干误判为一个;同时,树干纹理与背景对比度低,进一步增加分割难度。此外,幼苗数据有限,且不同生长期树干直径差异大,限制了模型对细长树干和枝条的提取能力。为此,我们提出一种利用频域特征的实例分割网络WaveInst。其核心是频域特征补偿分支,包含离散小波变换模块和高频增强模块:前者实现高低频分解并沿多方向聚合高频响应,后者通过多路径处理进一步优化高频特征。随后采用自适应门控融合模块,有效整合空间域卷积特征与频域表示,使解码器能利用嵌入的频域特征增强细节表达。我们在SynthTree43k、CaneTree100、UrbanStreet等公开数据集以及包含成年与幼年杨树的PoplarDataset上进行实验。在公开数据集上,WaveInst表现出强性能与稳定鲁棒性;在PoplarDataset上,对成年杨树的平均精度达53.1,对幼苗为29.1,优于现有最优方法6.6个百分点,验证了其在细长树干提取中的有效性。
原文摘要 · Abstract (English)
Analyzing tree morphology, particularly trunk and branch extraction, is valuable for genetic breeding and forestry management. Existing image-based deep learning methods tend to misidentify overlapping trunks as a single trunk when structural discontinuities occur due to front-back overlap, while low contrast between trunk textures and the background further complicates segmentation. Moreover, limited juvenile tree data, coupled with substantial variations in trunk diameter across growth stages, restricts model performance in extracting thin trunks and branches. Based on this, we propose an instance segmentation network leveraging frequency-domain features, WaveInst. Its core is a Frequency-domain Feature Compensation branch, consisting of Discrete Wavelet Transform block and High-Frequency Enhancement block. The former performs high- and low-frequency decomposition and aggregates high-frequency responses along multiple directions, while the latter further refines the high-frequency features through multi-path processing. An Adaptive Gated Fusion Module is then applied to effectively integrate spatial-domain convolutional features with frequency-domain representations, allowing the decoder to utilize embedded frequency-domain features to enhance its fine-grained detail representation. We conduct experiments on public datasets including SynthTree43k, CaneTree100, and UrbanStreet, as well as PoplarDataset, which contains both mature and juvenile poplar trees. On the public datasets, WaveInst demonstrates strong performance and stable robustness across diverse scenarios. On PoplarDataset, it achieves a mean average precision of 53.1 for mature and 29.1 for juvenile, outperforming existing state-of-the-art methods on juvenile by 6.6 points, demonstrating its effectiveness in extracting thin tree trunk.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。