用1MB标签替代图像传输,实现高效数据分发
A Dataset is Worth 1 MB
- 仅传输任务标签,不传像素数据,大幅降低通信开销
- 在10个数据集上实现<1MB传输量,准确率接近原数据
- 适合资源受限设备本地训练,尤其适用于边缘计算场景
数据集服务器常需向多个客户端分发大体积数据,通信成本高昂。由于客户端硬件和框架各异,直接传输预训练模型不可行,通常需提供原始数据以支持本地训练。尽管数据蒸馏可压缩训练信号,但现有方法难以扩展至高分辨率数据,且压缩后文件仍过大。本文提出伪标签即数据(PLADA)方法,彻底消除像素传输。假设客户端已预载大规模通用无标签参考数据集(如ImageNet-1K、ImageNet-21K),通过仅传输特定图像的类别标签来传达新任务。为缓解参考集与目标集之间的分布差异,引入筛选机制,保留对目标任务语义最相关的图像标签。该过程同时提升训练效率并最小化传输负载。在10个不同数据集上的实验表明,本方法可实现小于1MB的传输量,同时保持高分类准确率,为高效数据服务提供了可行方案。
原文摘要 · Abstract (English)
A dataset server must often distribute the same large payload to many clients, incurring massive communication costs. Since clients frequently operate on diverse hardware and software frameworks, transmitting a pre-trained model is often infeasible; instead, agents require raw data to train their own task-specific models locally. While dataset distillation attempts to compress training signals, current methods struggle to scale to high-resolution data and rarely achieve sufficiently small files. In this paper, we propose Pseudo-Labels as Data (PLADA), a method that completely eliminates pixel transmission. We assume agents are preloaded with a large, generic, unlabeled reference dataset (e.g., ImageNet-1K, ImageNet-21K) and communicate a new task by transmitting only the class labels for specific images. To address the distribution mismatch between the reference and target datasets, we introduce a pruning mechanism that filters the reference dataset to retain only the labels of the most semantically relevant images for the target task. This selection process simultaneously maximizes training efficiency and minimizes transmission payload. Experiments on 10 diverse datasets demonstrate that our approach can transfer task knowledge with a payload of less than 1 MB while retaining high classification accuracy, offering a promising solution for efficient dataset serving.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。