用合成序列提升3D实例分割的无监督训练效果
Unsupervised Online 3D Instance Segmentation with Synthetic Sequences and Dynamic Loss
- 通过合成点云序列增强训练多样性,无需人工标注或仿真引擎
- 灵活采样策略结合远近帧,学习长短期时序依赖关系
- 动态加权损失聚焦高置信样本,提升模型鲁棒性
无监督在线3D实例分割是一项基础但极具挑战的任务,需在不依赖标注数据的前提下保持点云扫描间物体身份的一致性。现有方法如UNIT虽有进展,但仍受限于训练数据多样性不足、时间采样僵化以及对噪声伪标签的强依赖。本文提出新框架:通过合成点云序列生成丰富训练分布,提升多样性且无需人工标注或仿真引擎;采用灵活采样策略,同时利用相邻与非相邻帧,使模型能捕捉长程依赖与短时变化;引入动态加权损失,强化高置信度、信息量丰富的样本,引导网络学习更鲁棒的表示。在SemanticKITTI、nuScenes和PandaSet上的大量实验表明,本方法持续优于UNIT及其他无监督基线,在分割精度与时序关联稳定性上均有显著提升。代码将公开于github.com/Eaphan/SFT3D。
原文摘要 · Abstract (English)
Unsupervised online 3D instance segmentation is a fundamental yet challenging task, as it requires maintaining consistent object identities across LiDAR scans without relying on annotated training data. Existing methods, such as UNIT, have made progress in this direction but remain constrained by limited training diversity, rigid temporal sampling, and heavy dependence on noisy pseudo-labels. We propose a new framework that enriches the training distribution through synthetic point cloud sequence generation, enabling greater diversity without relying on manual labels or simulation engines. To better capture temporal dynamics, our method incorporates a flexible sampling strategy that leverages both adjacent and non-adjacent frames, allowing the model to learn from long-range dependencies as well as short-term variations. In addition, a dynamic-weighting loss emphasizes confident and informative samples, guiding the network toward more robust representations. Through extensive experiments on SemanticKITTI, nuScenes, and PandaSet, our method consistently outperforms UNIT and other unsupervised baselines, achieving higher segmentation accuracy and more robust temporal associations. The code will be publicly available at github.com/Eaphan/SFT3D.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。