用多视角高斯点云实现果园跨季节实时三维建图
AgriGS-SLAM: Orchard Mapping Across Seasons via Multi-View Gaussian Splatting SLAM
- 融合视觉与激光雷达,通过高斯点云渲染重建果园结构
- 跨季节测试中精度优于现有方法,轨迹更稳定且保持实时性
- 适合需要鲁棒多模态感知的户外农业机器人场景
果园中自主机器人需在重复的行状结构、季节性外观变化和风动枝叶遮挡下实现实时3D场景理解。本文提出AgriGS-SLAM,一种结合直接激光雷达里程计与环路闭合的视觉-激光雷达SLAM框架,利用多相机3D高斯点云(3DGS)渲染技术。通过多视角批量光栅化,在遮挡情况下恢复果园结构;在关键帧间执行统一梯度驱动的地图生命周期管理,保留细节并控制内存占用。姿态优化由基于概率的激光雷达深度一致性项引导,反向传播至相机投影,强化几何-外观耦合。系统在苹果和梨园中部署于休眠、开花、收获期,采用标准化轨迹协议评估训练视图与新视图合成效果,降低3DGS过拟合风险。跨季节与场地测试表明,该方法重建结果更清晰、轨迹更稳定,且在拖拉机上保持实时性能。尽管应用于果园监测,该方法可推广至其他需鲁棒多模态感知的户外场景。
原文摘要 · Abstract (English)
Autonomous robots in orchards require real-time 3D scene understanding despite repetitive row geometry, seasonal appearance changes, and wind-driven foliage motion. We present AgriGS-SLAM, a Visual--LiDAR SLAM framework that couples direct LiDAR odometry and loop closures with multi-camera 3D Gaussian Splatting (3DGS) rendering. Batch rasterization across complementary viewpoints recovers orchard structure under occlusions, while a unified gradient-driven map lifecycle executed between keyframes preserves fine details and bounds memory. Pose refinement is guided by a probabilistic LiDAR-based depth consistency term, back-propagated through the camera projection to tighten geometry-appearance coupling. We deploy the system on a field platform in apple and pear orchards across dormancy, flowering, and harvesting, using a standardized trajectory protocol that evaluates both training-view and novel-view synthesis to reduce 3DGS overfitting in evaluation. Across seasons and sites, AgriGS-SLAM delivers sharper, more stable reconstructions and steadier trajectories than recent state-of-the-art 3DGS-SLAM baselines while maintaining real-time performance on-tractor. While demonstrated in orchard monitoring, the approach can be applied to other outdoor domains requiring robust multimodal perception.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。