arXiv:2607.01628cs.CV2026-07

无需预设,实时分割3D高斯点云,速度超快。

Online Segment 3D Gaussians via Launching Virtual Drones

论文配图:Online Segment 3D Gaussians via Launching Virtual Drones
图 1 · 摘自论文原文
  • 用虚拟无人机规划最佳视角,动态在线分割3D高斯
  • 分割延迟低于1秒,比之前方法快50倍以上
  • 适合需要即时交互的3D编辑、物体操作场景

3D高斯溅射(3DGS)支持实时渲染,为3D场景的交互式分割提供了可能。然而,现有方法需耗时数十秒甚至数分钟进行场景初始化——包括多视角掩码准备、掩码提升和特征蒸馏——严重阻碍了在线应用。为此,本文提出SAGO(Segment Any Gaussians Online),一种完全免预设的交互式3DGS分割框架。通过引入虚拟无人机,将3D分割重构为在线下一步最佳视角(NBV)规划问题,基于马尔可夫过程求解。大量实验表明,SAGO能以亚秒级延迟直接从3D高斯中提取干净3D资产,适用于物体操控与场景编辑等下游任务。相比此前无预设的3DGS分割方法,SAGO实现超过50倍的速度提升。

原文摘要 · Abstract (English)

Interactive segmentation of 3D Gaussians offers a compelling opportunity for real-time manipulation of 3D scenes, thanks to the real-time rendering capability of 3D Gaussian Splatting (3DGS). However, existing methods require a time-consuming per-scene setup - typically tens of seconds or even minutes - before interactive segmentation can begin on a raw 3DGS scene. This setup involves multi-view mask preparation, mask lifting, and feature distillation, creating a major bottleneck for online applications. To address this limitation, we aim to completely eliminate the setup stage for interactive 3DGS segmentation while keeping the segmentation time practical (under 1 second). In this work, we present SAGO (Segment Any Gaussians Online), a novel setup-free framework for interactive 3DGS segmentation. By introducing virtual drones, our method reframes the 3D segmentation problem as an online Next-Best-View (NBV) planning task formulated within a Markov process. Extensive experiments demonstrate that SAGO can extract clean 3D assets directly from 3D Gaussians with sub-second latency, thereby enabling a broad range of downstream applications such as object manipulation and scene editing. Moreover, our method achieves over a 50x speedup compared to the previous setup-free 3DGS segmentation frameworks.

3D分割高斯溅射在线交互实时渲染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。