让点云模型不惧分辨率和尺度变化,提升真实场景适应力。
Invaria: Learning Scale and Density Invariance in Point Clouds via Next-Resolution Prediction

- 通过预测下一分辨率点云来学习不变特征
- 分辨率降低3倍时mIoU提升56%,尺度缩小3倍时性能提升20%
- 模型更小、输入更少,适合部署于机器人等实际场景
现代图像编码器通过解耦语义与分辨率实现高泛化能力,但3D点云编码器尚未达到类似效果。现有模型对采样分辨率和尺度变化高度敏感,导致性能显著下降,这成为机器人等实际应用的瓶颈,说明模型过拟合特定量化密度和物体尺度,而非学习不变语义特征。为此,我们提出Invaria,通过下一分辨率预测和感受野校准实现尺度与密度不变性。尽管训练目标并非显式生成高分辨率点云,但该目标促使模型学习到稳健的结构不变量。所提编码器在分辨率变化时表现显著提升,同时保持高效:在ScanNet上,分辨率降至1/3时mIoU提升56.0%,物体尺度缩小3倍时性能提高20%。模型规模减小45%,输入令牌平均减少40%。
原文摘要 · Abstract (English)
Modern image encoders achieve high generalization by decoupling semantic meaning from resolution, an ability yet to be fully realized in the 3D domain. We investigate the failure of 3D point cloud encoders to achieve similar generalization and find that existing models are highly sensitive to sampling resolution and scale changes, leading to significant performance degradation. This sensitivity is a major bottleneck for real-world deployment in robotics, as it suggests models overfit to specific quantization densities and object scales rather than learning invariant semantic features. To mitigate this dependency, we propose Invaria, a point cloud encoder that achieves scale and density invariance through next-resolution prediction and receptive field calibration. While our objective is not the explicit generation of high-resolution point clouds, we find that this training objective encourages the model to learn robust, structural invariants. The resulting encoder achieves significant performance gains during resolution shifts while maintaining high efficiency through a compact model size and reduced token requirements. Specifically, on ScanNet, Invaria achieves a 56.0\% higher mIoU at 3$\times$ lower resolution and a 20\% improvement when the objects scale is reduced by a factor of 3. These gains are achieved with a 45\% smaller model size and an average reduction of 40\% in input tokens.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。