用智能选数据方法,用极少训练量恢复剪枝大模型性能。
PASER: Post-Training Data Selection for Efficient Pruned Large Language Model Recovery
- 按能力差异分组指令,精准定位受损模块
- 仅用原数据4%-20%就实现性能有效恢复
- 自动过滤无效或有害指令,避免负优化
模型剪枝虽能压缩大型语言模型(LLMs),但常导致能力严重下降。现有后训练方法多忽略能力退化不均问题,且计算开销高,部分无关指令还会带来负面效果。为此,我们提出高效剪枝模型恢复方法PASER。该方法首先通过流形学习与谱聚类在语义空间中分组恢复指令,识别出针对特定能力的指令集;再根据各能力退化程度,自适应分配数据预算;在每组内优先选择导致性能下降最严重的样本。为防止负向调优,还检测并剔除冲突或无关数据。大量实验表明,PASER显著优于基线方法,在仅使用原后训练数据4%-20%的情况下,有效恢复了剪枝模型的通用能力。
原文摘要 · Abstract (English)
Model pruning is an effective approach for compressing large language models (LLMs). However, this process often leads to significant degradation of model capabilities. While post-training techniques such as instruction tuning are commonly employed to recover model performance, existing methods often overlook the uneven deterioration of model capabilities and incur high computational costs. Moreover, some irrelevant instructions may also introduce negative effects to model capacity recovery. To address these challenges, we propose the \textbf{P}ost-training d\textbf{A}ta \textbf{S}election method for \textbf{E}fficient pruned large language model \textbf{R}ecovery (\textbf{PASER}). PASER aims to identify instructions to recover the most compromised model capacities with a certain data budget. Our approach first applies manifold learning and spectral clustering to group recovery instructions in the semantic space, revealing capability-specific instruction sets. Then, the data budget is adaptively allocated across clusters by the degree of corresponding model capability degradation. In each cluster, we prioritize data samples that lead to the most decline of model performance. To mitigate potential negative tuning effects, we also detect and filter out conflicting or irrelevant recovery data. Extensive experiments demonstrate that PASER significantly outperforms conventional baselines, effectively recovering the general capabilities of pruned LLMs while utilizing merely 4\%-20\% of the original post-training data. We provide the code repository in \href{https://github.com/BokwaiHo/PASER}{Link}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。