一模型同时识别杂草、测高、判生长期,效率比单任务快三倍。
WeedSense: Multi-Task Learning for Weed Segmentation, Height Estimation, and Growth Stage Classification
- 用双路编码器+分叉解码器,共享特征同时完成三项任务。
- 分割准确率89.78%,测高误差仅1.67厘米,分类准确率达99.99%。
- 适合精准农业、智能农机研发人员,支持实时推理部署。
杂草管理是农业中的关键挑战,直接影响作物产量并需大量资源控制。有效的监测与分析策略对实现可持续农业和精准管理至关重要。我们提出WeedSense,一种新型多任务学习架构,可联合执行语义分割、高度估计和生长阶段分类。构建了一个独特数据集,涵盖16种杂草在11周生长周期内的像素级标注、高度测量与时间标签。WeedSense采用包含通用反向瓶颈模块的双路径编码器,以及基于Transformer融合的多任务分叉解码器,生成多尺度特征并实现多任务同步预测。在综合评估中,WeedSense在本数据集上达到89.78% mIoU(分割)、1.67cm MAE(高度估计)和99.99%准确率(生长阶段分类),且推理速度达160 FPS。相比串行单任务,其推理速度快3倍,参数量减少32.4%。项目主页:weedsense.github.io。
原文摘要 · Abstract (English)
Weed management represents a critical challenge in agriculture, significantly impacting crop yields and requiring substantial resources for control. Effective weed monitoring and analysis strategies are crucial for implementing sustainable agricultural practices and site-specific management approaches. We introduce WeedSense, a novel multi-task learning architecture for comprehensive weed analysis that jointly performs semantic segmentation, height estimation, and growth stage classification. We present a unique dataset capturing 16 weed species over an 11-week growth cycle with pixel-level annotations, height measurements, and temporal labels. WeedSense leverages a dual-path encoder incorporating Universal Inverted Bottleneck blocks and a Multi-Task Bifurcated Decoder with transformer-based feature fusion to generate multi-scale features and enable simultaneous prediction across multiple tasks. WeedSense outperforms other state-of-the-art models on our comprehensive evaluation. On our multi-task dataset, WeedSense achieves mIoU of 89.78% for segmentation, 1.67cm MAE for height estimation, and 99.99% accuracy for growth stage classification while maintaining real-time inference at 160 FPS. Our multitask approach achieves 3$\times$ faster inference than sequential single-task execution and uses 32.4% fewer parameters. Please see our project page at weedsense.github.io.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。