通过分布匹配方法,将3D点云数据集压缩为合成数据,提升训练效率。
Dataset Distillation of 3D Point Clouds via Distribution Matching
- 基于分布匹配优化几何结构与方向,生成高质量合成点云
- 在多个基准数据集上准确率优于现有方法,跨架构泛化能力强
- 针对点云无序性与旋转变化设计新损失函数,适合点云领域研究者
大规模数据集通常用于训练深度神经网络,但会增加计算复杂度,阻碍实际应用。近年来,图像和文本的数据集压缩受到关注,可通过合成数据降低训练负担并保留关键任务信息。然而,3D点云的数据集压缩仍鲜有研究,因其点云特性与图像差异显著,压缩更具挑战。本文提出一种基于分布匹配的3D点云数据集压缩框架,联合优化合成3D对象的几何结构与朝向。为解决点云因点索引无序导致的语义错位,引入在各通道排序特征上计算的语义对齐分布匹配损失。同时,通过联合学习最优旋转角度,动态更新合成数据以更好对齐原始特征分布。在多个主流基准数据集上的大量实验表明,该方法持续优于现有数据集压缩方法,在准确率和跨架构泛化能力方面表现优异。
原文摘要 · Abstract (English)
Large-scale datasets are usually required to train deep neural networks, but it increases the computational complexity hindering the practical applications. Recently, dataset distillation for images and texts has been attracting a lot of attention, that reduces the original dataset to a synthetic dataset to alleviate the computational burden of training while preserving essential task-relevant information. However, the dataset distillation for 3D point clouds remains largely unexplored, as the point clouds exhibit fundamentally different characteristics from that of images, making the dataset distillation more challenging. In this paper, we propose a distribution matching-based distillation framework for 3D point clouds that jointly optimizes the geometric structures as well as the orientations of the synthetic 3D objects. To address the semantic misalignment caused by unordered indexing of points, we introduce a Semantically Aligned Distribution Matching loss computed on the sorted features in each channel. Moreover, to address the rotation variation, we jointly learn the optimal rotation angles while updating the synthetic dataset to better align with the original feature distribution. Extensive experiments on widely used benchmark datasets demonstrate that the proposed method consistently outperforms existing dataset distillation methods, achieving superior accuracy and strong cross-architecture generalization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。