针对机器人快速重建兴趣点,提出分阶段精细化优化方法。
CoRe-GS: Coarse-to-Refined Gaussian Splatting with Semantic Object Focus
- 先轻量级粗略分割,再聚焦兴趣点局部精细优化。
- 在多个数据集上将定位时间缩短91%-95%,浮点错误减少。
- 适合搜救等需快速响应的机器人场景使用。
基于(语义)高斯点云(GS)的快速高效三维真实感重建对时间敏感的机器人感知与导航至关重要,尤其在搜救等场景中,机器人需快速重建并检查特定兴趣点(POIs)。现有语义GS方法虽注重重建与分割质量,但对全场景进行均匀优化,常忽略实际部署中的运行时约束。此外,对象提取常出现浮点噪声和不完整重建,后处理优化方法也常导致兴趣点信息缺失。本文提出CoRe-GS,一种从粗到精、任务驱动的方法:首先通过轻量级后期语义精修生成可分割的GS表示,随后仅对与兴趣点相关的视角和高斯点进行选择性细化;结合颜色过滤策略进一步抑制分割引起的浮点噪声。在LERF-Mask上,本方法以6-8倍更少的优化步数达到竞争性mIoU;在NeRDS 360和SCRREAM上,相比全场景语义GS,时间至兴趣点降低91%-95%,同时提升重建质量并减少浮点。在所有基准测试中,比后处理对象提取快44%-76%,证明任务感知的细化能实现高效且高质量的兴趣点重建,适用于时间敏感的机器人感知与操作。
原文摘要 · Abstract (English)
Fast and efficient photorealistic 3D reconstruction with (semantic) Gaussian Splatting (GS) is crucial for time-critical robotic perception and navigation, where robots may need to rapidly reconstruct and inspect specific points of interest (POIs), such as in search-and-rescue scenarios. Existing semantic GS methods prioritize reconstruction and segmentation quality while uniformly optimizing entire scenes, often overlooking runtime constraints crucial for real-world deployment. Moreover, object extraction often suffers from floaters and incomplete reconstructions, while post-optimization approaches often produce incomplete POIs. We propose CoRe-GS, a coarse-to-refined, task-driven approach that first creates a segmentation-ready GS representation through lightweight late-stage semantic refinement, then selectively refines only the views and Gaussians associated with the POI. A color-based filtering strategy further suppresses segmentation-induced floaters. On LERF-Mask, our representation achieves competitive mIoU with 6-8x fewer optimization steps. On NeRDS 360 and SCRREAM, CoRe-GS reduces time-to-POI by 91-95% over full-scene semantic GS while improving reconstruction quality and reducing floaters. Across all benchmarks, it is 44-76% faster than post-optimization object extraction, demonstrating that task-aware refinement can deliver efficient, high-quality POI reconstruction for time-critical robotic perception and operation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。