提出首个无需神经网络的分布匹配核心集选择方法,显著提升模型效率与精度。
FAST: Topology-Aware Frequency-Domain Distribution Matching for Coreset Selection
- 基于频域特征函数距离和图约束优化,实现无模型依赖的核心集生成
- 在多个基准上平均准确率提升9.12%,能耗降低96.57%,速度提升2.2倍
- 适合追求高效训练、低功耗部署的深度学习应用开发者
核心集选择通过压缩大规模数据集为紧凑代表性子集,降低深度神经网络训练的能耗与计算负担。现有方法分为两类:(i) 基于DNN的方法受模型参数绑定,引入架构偏差;(ii) 无DNN方法依赖启发式规则,缺乏理论保障。二者均未显式约束分布等价性,因连续分布匹配被认为不适用于离散采样。此外,主流指标(如MSE、KL、CE、MMD)无法准确捕捉高阶矩差异,导致核心集性能不佳。本文提出FAST,首个无需神经网络的分布匹配核心集选择框架,将核心集选择建模为基于谱图理论的图约束优化问题,并采用特征函数距离(CFD)在频域中捕获完整分布信息。我们发现原始CFD在中高频区域存在“相位梯度消失”问题,为此提出衰减相位解耦的CFD。为进一步提升收敛性,设计渐进式差异感知采样策略,从低频到高频逐步调度频率选择,先保留全局结构再细化局部细节,以更少频率实现精准匹配并避免过拟合。大量实验表明,FAST在所有评估基准上显著优于现有最优方法,平均准确率提升9.12%。相比其他基线方法,其功耗降低96.57%,平均提速2.2倍,验证了其高性能与高能效。
原文摘要 · Abstract (English)
Coreset selection compresses large datasets into compact, representative subsets, reducing the energy and computational burden of training deep neural networks. Existing methods are either: (i) DNN-based, which are tied to model-specific parameters and introduce architectural bias; or (ii) DNN-free, which rely on heuristics lacking theoretical guarantees. Neither approach explicitly constrains distributional equivalence, largely because continuous distribution matching is considered inapplicable to discrete sampling. Moreover, prevalent metrics (e.g., MSE, KL, CE, MMD) cannot accurately capture higher-order moment discrepancies, leading to suboptimal coresets. In this work, we propose FAST, the first DNN-free distribution-matching coreset selection framework that formulates the coreset selection task as a graph-constrained optimization problem grounded in spectral graph theory and employs the Characteristic Function Distance (CFD) to capture full distributional information in the frequency domain. We further discover that naive CFD suffers from a "vanishing phase gradient" issue in medium and high-frequency regions; to address this, we introduce an Attenuated Phase-Decoupled CFD. Furthermore, for better convergence, we design a Progressive Discrepancy-Aware Sampling strategy that progressively schedules frequency selection from low to high, preserving global structure before refining local details and enabling accurate matching with fewer frequencies while avoiding overfitting. Extensive experiments demonstrate that FAST significantly outperforms state-of-the-art coreset selection methods across all evaluated benchmarks, achieving an average accuracy gain of 9.12%. Compared to other baseline coreset methods, it reduces power consumption by 96.57% and achieves a 2.2x average speedup, underscoring its high performance and energy efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。