arXiv:2605.21558cs.LGcs.CL2026-05中稿 · ICML

通过关键注意力头同步筛选数据与优化参数,实现高效大模型对齐。

From Parameters to Data: A Task-Parameter-Guided Fine-Tuning Pipeline for Efficient LLM Alignment

论文配图:From Parameters to Data: A Task-Parameter-Guided Fine-Tuning Pipeline for Efficient LLM Alignment
图 1 · 摘自论文原文
  • 用注意力头作为筛选数据和剪枝的双重指引,实现参数与数据协同优化。
  • 仅更新10%参数、使用10%数据,性能比基线高8.3个百分点,提速7.0倍。
  • 适合追求高效微调的大模型应用者,尤其关注资源受限场景。

将大语言模型适配到特定领域通常需要大量数据和计算开销。以往的效率工作多将数据选择与参数高效微调视为独立过程,但我们的实证分析表明二者可能存在内在关联。我们提出强映射假设:少数注意力头在任务特异性适应中起主导作用,如同钥匙解锁特定数据模式。基于此,我们提出从参数到数据(P2D)统一框架,利用这些任务敏感的注意力头作为双重指引,同时指导样本挖掘与结构剪枝。为量化整体管道成本,引入对齐效率比(AER)指标,衡量选择延迟与训练时间。机制上,P2D通过轻量代理识别关键头,并将其作为功能过滤器,筛选高匹配度数据,构建协同流程。实证显示,仅更新10%的注意力头并使用10%的数据,即可实现比强基线高出8.3个百分点的性能提升,并获得7.0倍的端到端速度提升。结果验证了精准的参数-数据同步可消除冗余,开启高效对齐的新范式。

原文摘要 · Abstract (English)

Adapting Large Language Models (LLMs) to specialized domains typically incurs high data and computational overhead. While prior efficiency efforts have largely treated data selection and parameter-efficient fine-tuning as isolated processes, our empirical analysis suggests they may be intrinsically coupled. We posit the Strong Map Hypothesis: a sparse subset of attention heads plays a dominant role in task-specific adaptation, acting as keys that unlock specific data patterns. Building on this observation, we propose From Parameters to Data (P2D), a unified framework that leverages these task-sensitive attention heads as a dual compass for both sample mining and structural pruning. To rigorously quantify the total pipeline cost, we introduce the Alignment Efficiency Ratio (AER) metric for both selection latency and training time. Mechanistically, P2D identifies critical heads via a lightweight proxy and uses them as a functional filter to curate high-affinity data, establishing a synergistic pipeline. Empirically, by updating merely 10% of attention heads on 10% of the data, P2D achieves an 8.3 pp performance gain over strong baselines and delivers a 7.0x end-to-end time speedup. These results validate that precise parameter-data synchronization eliminates redundancy, offering a new paradigm for efficient alignment.

大模型对齐高效微调注意力头

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。