通过筛选低影响点提升点云分类鲁棒性,兼顾高效与抗噪。
Point-Selection Fine-Tuning Framework for Robust Point Cloud Classification

- 基于特征影响力筛选低干扰点,抑制异常值
- 轻量级提示注入实现参数高效微调,误差降低20%以上
- 适合3D点云模型在噪声数据下的稳健部署
噪声和损坏的点会显著降低点云识别性能,尤其在严苛的污染条件下。3D预训练模型的全量微调可能放大异常值的影响,并覆盖预训练中学习到的鲁棒性先验;而简单的参数高效适配仍对损坏点敏感。为此,我们提出PSFT,一种点选择微调框架,在保持参数高效的同时提升鲁棒性。PSFT首先从预池化特征中估计点级影响,自适应保留影响最小的点以抑制异常值。基于筛选后的子集,提示生成分支预测层间提示令牌并注入冻结主干进行轻量下游适配。为进一步消除筛选后的残余噪声,我们添加一个轻量级特征过滤器,包含瓶颈MLP变换与Beta门控残差融合,以优化补丁-令牌表示后再进行预测。大量实验表明,PSFT在ModelNet-C和ModelNet40-C上持续降低污染误差,所有测试3D预训练主干均表现更优;在ScanObjectNN-C上,使用ULIP-2和Uni3D-B时取得最佳结果。代码已开源。
原文摘要 · Abstract (English)
Noisy and corrupted points can substantially degrade point cloud recognition performance, especially under challenging corruption settings. In particular, full fine-tuning of 3D pre-trained models may amplify the influence of outliers and overwrite robustness priors learned during pre-training, while naive parameter-efficient adaptation remains sensitive to corrupted tokens. To address this issue, we propose PSFT, a point-selection fine-tuning framework that improves robustness while remaining parameter-efficient. PSFT first estimates point-wise influence from pre-pooling features and adaptively retains minimally influential points to suppress outliers. Based on the selected subset, a prompt generation branch predicts layer-wise prompt tokens and injects them into a frozen backbone for lightweight downstream adaptation. To further mitigate residual noise after selection, we append a lightweight feature filter with bottleneck MLP transformation and Beta-gated residual blending to refine patch-token representations before prediction. Extensive experiments show that PSFT consistently reduces corruption error on ModelNet-C and ModelNet40-C across all tested 3D pre-trained backbones, while achieving the strongest ScanObjectNN-C results with ULIP-2 and Uni3D-B among the evaluated tuning strategies. Our implementation can be found at https://github.com/CVChMA/PSFT/tree/master.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。