用扩散模型修复模糊叶片图像,自动精准识别气孔特征。
StomaD2: An All-in-One System for Intelligent Stomatal Phenotype Analysis via Diffusion-Based Restoration Detection Network
- 结合扩散恢复与旋转目标检测,提升复杂图像中气孔识别能力。
- 在玉米小麦数据集上准确率达99.4%和99.2%,F1-score达0.989。
- 支持野外部署,可快速提取8种气孔表型,适用于多种植物。
气孔在调节植物生理过程和响应环境变化中起关键作用,但传统表型分析依赖破坏性采样和人工标注,难以实现大规模、田间应用。为此,本文提出StomaD2——一种集成图像恢复与检测的非侵入式框架,可在复杂成像条件下实现高精度、快速的气孔表型分析。该框架包含基于扩散模型的图像恢复模块,以及针对小尺寸、密集、杂乱分布气孔特点设计的旋转目标检测网络。通过列式结构增强全局特征交互,引入上下文感知重采样与重加权机制提升多尺度一致性,并设计特征重组模块以增强对复杂背景的区分能力。在公开的玉米与小麦数据集上,准确率分别达到0.994和0.992,显著优于现有方法;在十种先进模型对比中,获得0.989的最高F1-score/mAP。系统已集成至用户友好的田间可操作平台,支持8种气孔表型(如密度、导度)的快速提取。在超过130种植物上的验证表明其具备强泛化能力,具有在大规模表型分析、植物生理研究及精准农业中的应用潜力。
原文摘要 · Abstract (English)
Stomata play a crucial role in regulating plant physiological processes and reflecting environmental responses. However, accurate and high-throughput stomatal phenotyping remains challenging, as conventional approaches rely on destructive sampling and manual annotation, restricting large-scale and field deployment. To overcome these limitations, a noninvasive restoration-detection integrated framework, termed StomaD2, is developed to achieve accurate and fast stomatal phenotyping under complex imaging conditions. The framework incorporates a diffusion-based restoration module to recover degraded images and a specialized rotated object detection network tailored to the small, dense, and cluttered characteristics of stomata. The proposed network enhances feature representation through three key innovations: a column-wise structure for global feature interaction, context-aware resampling and reweighting mechanism to improve multi-scale consistency, and a feature reassembly module to boost discrimination against complex backgrounds. In extensive comparisons, StomaD2 demonstrated state-of-the-art performance. On public Maize and Wheat datasets, it achieved accuracies of 0.994 and 0.992, respectively, significantly outperforming existing benchmarks. When benchmarked against ten other advanced models, including Oriented Former and YOLOv12, StomaD2 achieved a top-tier F1-score/mAP of 0.989. The framework is integrated into a user-friendly, field-operable system that supports the fast extraction of eight stomatal phenotypes, such as density and conductance. Validated on more than 130 plant species, StomaD2's results highlight its strong generalizability and potential for large-scale phenotyping, plant physiology analysis, and precision agriculture applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。