arXiv:2509.23873cs.CL2025-09被引 9

通过联合剪枝样本和令牌,用少量数据实现更优的模型微调效果。

Winning the Pruning Gamble: A Unified Approach to Joint Sample and Token Pruning for Efficient Supervised Fine-Tuning

  • 构建误差-不确定性平面,统一评估样本与令牌的价值。
  • 在仅使用12.5%数据时,相比全量训练提升38%性能。
  • 适合资源受限下高效微调大模型的研究者与工程师。

随着监督微调(SFT)从轻量后训练演变为计算密集型阶段,数据效率成为在预算限制下对齐大语言模型的关键。现有方法仅在样本或令牌层面单独剪枝,导致高价值样本仍含冗余信息,且关键指令信号常被误删。为此,我们提出误差-不确定性(EU)平面,联合刻画数据在样本与令牌层面的异质性价值。基于此,设计分象限微调(Q-Tuning),采用两阶段策略:先保留富含错误认知或校准信号的样本;再对错误样本中的非关键令牌实施上下文感知的不对称剪枝,完整保留校准样本。该方法在五个基准上达到新最优。尤其在SmolLM2-1.7B上,仅用12.5%原始数据即实现比全数据基线+38%的平均提升。作为首个动态剪枝始终超越全量训练的方法,Q-Tuning为预算受限下的高效数据利用提供了可扩展方案。

原文摘要 · Abstract (English)

As supervised fine-tuning (SFT) evolves from a lightweight post-training step into a compute-intensive phase rivaling mid-training in scale, data efficiency has become critical for aligning large language models (LLMs) under tight budgets. Existing data pruning methods suffer from a fragmented design: they operate either at the sample level or the token level in isolation, failing to jointly optimize both dimensions. This disconnect leads to significant inefficiencies--high-value samples may still contain redundant tokens, while token-level pruning often discards crucial instructional or corrective signals embedded in individual examples. To address this bottleneck, we introduce the Error-Uncertainty (EU) Plane, a diagnostic framework that jointly characterizes the heterogeneous utility of training data across samples and tokens. Guided by this insight, we propose Quadrant-based Tuning (Q-Tuning), a unified framework that strategically coordinates sample pruning and token pruning. Q-Tuning employs a two-stage strategy: first, it performs sample-level triage to retain examples rich in informative misconceptions or calibration signals; second, it applies an asymmetric token-pruning policy, using a context-aware scoring mechanism to trim less salient tokens exclusively from misconception samples while preserving calibration samples in their entirety. Our method sets a new state of the art across five diverse benchmarks. Remarkably, on SmolLM2-1.7B, Q-Tuning achieves a +38\% average improvement over the full-data SFT baseline using only 12.5\% of the original training data. As the first dynamic pruning approach to consistently outperform full-data training, Q-Tuning provides a practical and scalable blueprint for maximizing data utilization in budget-constrained LLM SFT.

模型压缩微调优化数据效率剪枝

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。