让无人机在森林中零样本导航,光照变化也不怕。
Zero-Shot UAV Navigation in Forests via Relightable 3D Gaussian Splatting
- 用可调光的3D高斯点云重建环境,分离光照与几何
- 在模拟中训练时加入强光到阴天等多种光照,提升鲁棒性
- 轻量无人机实测达10米/秒,无需调参就能过林区
使用单目视觉进行非结构化户外环境下的无人机导航,受限于仿真与现实间巨大的视觉域差距。尽管3D高斯点云能从真实数据中实现逼真场景重建,但现有方法将静态光照与几何结构耦合,严重限制了策略在动态光照下的泛化能力。本文提出一种端到端强化学习框架,用于高效零样本迁移至非结构化户外环境。在基于真实数据构建的高保真仿真环境中,策略直接将原始单目RGB观测映射为连续控制指令。为克服光度限制,我们引入可调光3D高斯点云,通过分解场景成分,实现神经表示内环境光照的显式、物理合理编辑。通过在训练中加入从强方向阳光到漫射阴天等多种合成光照条件,迫使策略学习鲁棒的光照不变视觉特征。大量真实世界实验表明,轻量四旋翼无人机在复杂森林环境中以最高10米/秒的速度实现稳定、无碰撞导航,对剧烈光照变化表现出显著鲁棒性,且无需微调。
原文摘要 · Abstract (English)
UAV navigation in unstructured outdoor environments using passive monocular vision is hindered by the substantial visual domain gap between simulation and reality. While 3D Gaussian Splatting enables photorealistic scene reconstruction from real-world data, existing methods inherently couple static lighting with geometry, severely limiting policy generalization to dynamic real-world illumination. In this paper, we propose a novel end-to-end reinforcement learning framework designed for effective zero-shot transfer to unstructured outdoors. Within a high-fidelity simulation grounded in real-world data, our policy is trained to map raw monocular RGB observations directly to continuous control commands. To overcome photometric limitations, we introduce Relightable 3D Gaussian Splatting, which decomposes scene components to enable explicit, physically grounded editing of environmental lighting within the neural representation. By augmenting training with diverse synthesized lighting conditions ranging from strong directional sunlight to diffuse overcast skies, we compel the policy to learn robust, illumination-invariant visual features. Extensive real-world experiments demonstrate that a lightweight quadrotor achieves robust, collision-free navigation in complex forest environments at speeds up to 10 m/s, exhibiting significant resilience to drastic lighting variations without fine-tuning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。