根据任务需求动态调整3D高斯点云密度,提升机器人实时建图效率。
GaussLite: Online Task-Conditioned 3D Gaussian Splatting for Real-Time Robotic Mapping

- 按自然语言任务指定目标区域,动态分配高斯点密度和优化资源。
- 在4Hz实时运行下,场景关键区峰值信噪比提升2.72dB(Replica数据集)。
- 适合移动机器人、自动驾驶等需快速聚焦特定任务的场景。
现有3D高斯点云(3DGS)系统对场景各处均匀分配表示能力,忽视了多数下游机器人任务仅关注部分几何结构。这导致宝贵计算资源被用于无关区域,限制在线处理能力或弱化关键区域优化。本文提出GaussLite,一种基于任务驱动的3DGS映射系统,其表示密度由自然语言任务指令决定。给定带位姿的RGB-D流与任务如“准备拿起桌上的物体”,GaussLite通过一次调用的LLM解析器提取目标与锚定物体,并由开放词汇检测器逐帧定位并分割生成像素级相关性掩码。映射器据此分配高斯点种子密度、梯度传播与尺度。在相同高斯点预算及资源受限硬件上实现4Hz实时映射,相比基线在Replica数据集的关键区域PSNR平均提升+2.72dB;真实硬件演示中室内室外场景亦提升+2.23dB。进一步表明,两个任务专用代理的地图可通过每体素投票活跃优化次数实时融合,相较拼接法提升+3.42dB,且仅共享平均7.08%的地图内容。
原文摘要 · Abstract (English)
Existing 3D Gaussian Splatting (3DGS) systems distribute representation capacity uniformly across a scene, ignoring the fact that many downstream robotic tasks engage only a fraction of the reconstructed geometry. This causes valuable onboard compute to be allocated towards optimizing irrelevant parts of the scene, either limiting online capacity or under-optimizing the most relevant parts of the scene. We introduce GaussLite, a task-driven 3DGS mapping system that conditions its representation density on a natural-language task specification. Given a posed RGB-D stream and a task such as "prepare to pick up the object on the desk," GaussLite uses a one-shot LLM parser to extract target and anchor objects, which are grounded per-frame by an open-vocabulary detector and segmented to produce per-pixel relevance masks in real time. The mapper allocates seeding density, gradient flow and scaling by task relevance. At matched Gaussian budget and real-time mapping at 4 Hz on resource-constrained hardware, GaussLite outperforms baselines on ROI PSNR on the Replica Dataset by an average +2.72 dB and on a real-hardware demonstration in indoor and outdoor settings by +2.23 dB. We further show that two task-specialized agents' maps can be fused into a single shared map via per-voxel voting on active-optimization counts in real time, outperforming concatenation by +3.42 dB while only sharing an average 7.08% of the map.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。