arXiv:2410.06418cs.CV2024-10ICLR被引 3

用形状模型替代原始数据,实现3D分类的低内存、高隐私持续学习。

MIRACLE3D: Memory-efficient Integrated Robust Approach for Continual Learning on Point Clouds via Shape Model Construction

  • 为每类构建紧凑形状模型,仅存均值与关键变化模式。
  • 在ModelNet40上内存仅需对手15%,ScanNet上仅8.5%仍达先进性能。
  • 适合资源受限或重视数据隐私的3D点云持续学习场景。

本文提出一种面向3D物体分类的高效且隐私保护的持续学习框架。不同于传统需存储大量样本的方法,本方法为每类构建紧凑形状模型,仅保留均值形状及少数关键变化模式。该策略在大幅降低内存占用的同时,支持生成多样化训练样本,并通过不存储原始数据增强隐私性。为提升模型对输入变化的鲁棒性(3D领域常见问题),引入梯度模式正则化,增强模型稳定性并扩大分类边界,带来准确率提升。在ModelNet40、ShapeNet和ScanNet数据集上广泛验证,结果表明:在ModelNet40和ShapeNet上内存消耗仅为对比方法的15%,在更具挑战性的ScanNet上仅需8.5%内存即可达到相当性能,充分展现该框架在可扩展性、有效性与隐私保护方面的优势。

原文摘要 · Abstract (English)

In this paper, we introduce a novel framework for memory-efficient and privacy-preserving continual learning in 3D object classification. Unlike conventional memory-based approaches in continual learning that require storing numerous exemplars, our method constructs a compact shape model for each class, retaining only the mean shape along with a few key modes of variation. This strategy not only enables the generation of diverse training samples while drastically reducing memory usage but also enhances privacy by eliminating the need to store original data. To further improve model robustness against input variations, an issue common in 3D domains due to the absence of strong backbones and limited training data, we incorporate Gradient Mode Regularization. This technique enhances model stability and broadens classification margins, resulting in accuracy improvements. We validate our approach through extensive experiments on the ModelNet40, ShapeNet, and ScanNet datasets, where we achieve state-of-the-art performance. Notably, our method consumes only 15% of the memory required by competing methods on the ModelNet40 and ShapeNet, while achieving comparable performance on the challenging ScanNet dataset with just 8.5% of the memory. These results underscore the scalability, effectiveness, and privacy-preserving strengths of our framework for 3D object classification.

持续学习3D点云低内存隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。