用潜在空间规划让农机在杂乱农田中零样本自适应导航
LeCropFollow: Latent Space Planning for Navigation in Unstructured Crop Fields

- 不依赖几何建模,直接在语义热图的潜在空间中优化路径
- 田间实验显示对种植空隙场景性能提升2.4倍,显著降低误判率
- 适合复杂不规则农田,无需调参即可从仿真直接部署到现实
非结构化导航特征(如不规则种植或断连)仍是地下农业机器人失败的主要原因。现有几何方法常因将高维视觉数据压缩为确定性空间参考而失效,丢弃了导航模糊地形所需的不确定性与语义上下文。为此,我们提出LeCropFollow,一种无需显式几何建模的视觉导航框架,采用学习的潜在表示进行路径规划。通过融合自监督语义热图提取器与基于模型的强化学习规划器TD-MPC2,系统在未压缩的热图信号上直接优化轨迹,保留了几何简化所丢失的语义上下文。实验表明,这种表征转变使系统能零样本迁移至真实世界而无需微调。在晚季玉米田的大量实地测试中,LeCropFollow在非结构化行进中达到当前最优基线水平,但在种植空隙场景中表现更优,相比关键点法减少2.4倍语义错误。结果表明,潜在空间规划为异质农业环境中的作业提供了稳健替代方案。代码、模型与数据:https://felipe-tommaselli.github.io/lecropfollow。
原文摘要 · Abstract (English)
Unstructured navigational features, such as irregular planting or discontinuities, remain the primary failure mode for under-canopy agricultural robots. Existing geometric approaches often fail in these scenarios because they compress high-dimensional visual data into deterministic spatial references, effectively discarding the uncertainty and semantic context required to navigate ambiguous terrain. To address this, we present LeCropFollow, a visual navigation framework that bypasses explicit geometric modeling in favor of a learned latent representation. By integrating a self-supervised semantic heatmap extractor with TD-MPC2, a Model-Based Reinforcement Learning (MBRL) planner, our system optimizes trajectories directly within a latent manifold. The framework operates over the uncompressed heatmap signal, preserving the semantic context that geometric reductions discard. We demonstrate that this representational shift enables zero-shot transfer from simplified simulation to the physical world without fine-tuning. Extensive field experiments in late-stage corn fields show that LeCropFollow matches state-of-the-art baselines in unstructured rows but significantly outperforms them in plantation gaps, achieving a 2.4x reduction in semantic failures compared to keypoint-based methods. These results suggest that latent planning offers a robust alternative to geometric estimation for operations in heterogeneous agricultural environments. Code, models, and data available: https://felipe-tommaselli.github.io/lecropfollow .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。