arXiv:2509.26219cs.CVcs.AI2025-09被引 1

用高斯点云参数化数据集蒸馏,高效压缩且保持性能

Parameterizing Dataset Distillation via Gaussian Splatting

  • 基于高斯点云实现数据集参数化,支持批量并行训练
  • 在相同存储预算下显著提升蒸馏数据多样性,提升模型性能
  • 适用于图像与视频蒸馏,计算高效且跨GPU稳定

数据集蒸馏旨在压缩训练数据以保留训练相关知识,减少对大规模数据集的依赖。数据集参数化提供更高效的存储结构,降低冗余并容纳更丰富信息。然而,现有方法或依赖复杂辅助模块,或难以平衡表达能力与效率。本文提出GSDD,一种基于高斯点云(Gaussian Splatting)的简单、新颖且有效的数据集蒸馏参数化方法。通过适配基于CUDA的点云渲染算子,实现批量并行训练,以极低计算与内存开销获得高质量重建。高斯基元能有效捕捉有意义的训练特征,实现稀疏但富有表现力的单张图像表示。结合高表达能力与高效率,GSDD在给定存储预算下显著提升蒸馏数据多样性,从而改善蒸馏性能。在多个标准基准上取得竞争力结果,并在ImageNet-1K等大规模数据集及视频蒸馏任务中实现显著性能提升。此外,我们进行了全面评估,涵盖计算效率、内存占用与跨GPU架构稳定性。代码已开源。

原文摘要 · Abstract (English)

Dataset distillation aims to compress training data while preserving training-aware knowledge, alleviating the reliance on large-scale datasets in modern model training. Dataset parameterization provides a more efficient storage structure for dataset distillation, reducing redundancy and accommodating richer information. However, existing methods either rely on complex auxiliary modules or fail to balance representational capacity and efficiency. In this paper, we propose GSDD, a simple, novel, and effective dataset parameterization technique for Dataset Distillation based on Gaussian Splatting. We adapt CUDA-based splatting operators for parallel training in batch, enabling high-quality rendering with minimal computational and memory overhead. Gaussian primitives can effectively capture meaningful training features, allowing a sparse yet expressive representation of individual images. Leveraging both high representational capacity and efficiency, GSDD substantially increases the diversity of distilled datasets under a given storage budget, thereby improving distillation performance. Beyond achieving competitive results on multiple standard benchmarks, GSDD also delivers significant performance gains on large-scale datasets such as ImageNet-1K and on video distillation tasks. In addition, we conduct comprehensive benchmarks to evaluate the computational efficiency, memory footprint, and cross-GPU architectural stability of GSDD. Code is available on https://github.com/j-cyoung/GSDatasetDistillation

数据集蒸馏高斯点云参数化高效训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。