arXiv:2509.22150cs.CVcs.IR2025-09被引 6

通过联合图熵蒸馏,提升点云分类对非独立同分布数据和噪声的鲁棒性。

Joint graph entropy knowledge distillation for point cloud classification and robustness against corruptions

  • 构建联合图熵损失函数,捕捉类别间隐藏关联进行知识迁移。
  • 在多个数据集上实现与主流方法相当的准确率,且抗干扰能力更强。
  • 适合处理存在类间相关性或受噪声影响的点云分类任务。

3D点云分类常假设类别独立同分布(IID),但此假设破坏了类别间的实际关联。本文提出一种适用于非独立同分布点云数据的分类策略——联合图熵知识蒸馏(JGEKD),通过基于联合图熵的损失函数实现类别相关性的知识迁移。首先,利用联合图捕获类别间的隐含关系,并通过计算图熵实现知识蒸馏训练。其次,为应对点云对空间变换的不变性,设计孪生结构,构建自知识蒸馏与教师-学生知识蒸馏两种框架,促进同一数据不同变换形式间的信息传递。此外,该框架还用于点云与其损坏形式之间的知识迁移,显著提升模型对各类扰动的鲁棒性。在ScanObject、ModelNet40、ScanNetV2_cls和ModelNet-C上的大量实验表明,所提方法性能具有竞争力。

原文摘要 · Abstract (English)

Classification tasks in 3D point clouds often assume that class events \replaced{are }{follow }independent and identically distributed (IID), although this assumption destroys the correlation between classes. This \replaced{study }{paper }proposes a classification strategy, \textbf{J}oint \textbf{G}raph \textbf{E}ntropy \textbf{K}nowledge \textbf{D}istillation (JGEKD), suitable for non-independent and identically distributed 3D point cloud data, \replaced{which }{the strategy } achieves knowledge transfer of class correlations through knowledge distillation by constructing a loss function based on joint graph entropy. First\deleted{ly}, we employ joint graphs to capture add{the }hidden relationships between classes\replaced{ and}{,} implement knowledge distillation to train our model by calculating the entropy of add{add }graph.\replaced{ Subsequently}{ Then}, to handle 3D point clouds \deleted{that is }invariant to spatial transformations, we construct \replaced{S}{s}iamese structures and develop two frameworks, self-knowledge distillation and teacher-knowledge distillation, to facilitate information transfer between different transformation forms of the same data. \replaced{In addition}{ Additionally}, we use the above framework to achieve knowledge transfer between point clouds and their corrupted forms, and increase the robustness against corruption of model. Extensive experiments on ScanObject, ModelNet40, ScanntV2\_cls and ModelNet-C demonstrate that the proposed strategy can achieve competitive results.

点云分类知识蒸馏鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。