用卫星图生成无人机级细节,提升作物性状预测精度
Crossmodal learning for Crop Canopy Trait Estimation
- 跨模态学习对齐卫星与无人机图像的光谱空间特征
- 生成的模拟无人机图像在产量和氮含量预测上优于真实卫星图
- 适合需要高精度农田监测的农业研究与智能农作系统
植物表型技术的发展推动了多传感器平台在作物冠层反射率数据采集中的广泛应用。其中,无人机(UAV)因在作物监测、预测等任务中表现优异而被广泛使用;卫星任务也展现出农业应用的有效性,但受限于空间分辨率,难以满足聚焦微小区块管理的现代农场需求。本文提出一种跨模态学习策略,将高分辨率无人机视觉细节注入卫星影像,以增强其作物冠层性状估计能力。基于在美国玉米带五个不同地点采集的84个杂交玉米品种、约同注册的卫星-无人机图像对数据集,训练模型学习两种传感模态间的细粒度光谱空间对应关系。结果表明,从卫星输入生成的类无人机表示在多个下游任务中持续优于真实卫星影像,包括产量与氮素预测,证明了跨模态对应学习在弥合卫星与无人机感知差距方面的潜力。
原文摘要 · Abstract (English)
Recent advances in plant phenotyping have driven widespread adoption of multi sensor platforms for collecting crop canopy reflectance data. This includes the collection of heterogeneous data across multiple platforms, with Unmanned Aerial Vehicles (UAV) seeing significant usage due to their high performance in crop monitoring, forecasting, and prediction tasks. Similarly, satellite missions have been shown to be effective for agriculturally relevant tasks. In contrast to UAVs, such missions are bound to the limitation of spatial resolution, which hinders their effectiveness for modern farming systems focused on micro-plot management. In this work, we propose a cross modal learning strategy that enriches high-resolution satellite imagery with UAV level visual detail for crop canopy trait estimation. Using a dataset of approximately co registered satellite UAV image pairs collected from replicated plots of 84 hybrid maize varieties across five distinct locations in the U.S. Corn Belt, we train a model that learns fine grained spectral spatial correspondences between sensing modalities. Results show that the generated UAV-like representations from satellite inputs consistently outperform real satellite imagery on multiple downstream tasks, including yield and nitrogen prediction, demonstrating the potential of cross-modal correspondence learning to bridge the gap between satellite and UAV sensing in agricultural monitoring.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。