arXiv:2509.07311cs.CLcs.AI2025-09

通过分析模型内部表示,自动挑选对训练更有帮助的不熟悉数据。

Does This Look Familiar to You? Knowledge Analysis via Model Internal Representations

  • 利用模型各层隐藏状态与最终输出的相似度评估数据熟悉度。
  • 在小样本下用简单分类器筛选不熟悉数据,提升模型泛化能力。
  • 适用于阅读理解、摘要等多类任务,无需复杂提示工程。

大型语言模型的进步依赖于预训练、监督微调(SFT)和对齐调优。其中,SFT将模型的通用知识转化为特定任务的结构化响应。然而,目前缺乏有效的训练数据选择方法。单纯增加数据量并不保证性能提升,而预处理、采样和验证则需大量时间和成本。为此,已有多种数据选择方法被提出,其中基于知识的方法通过分析模型输出来识别合适数据。但这些方法通常依赖提示工程,对变化敏感且需额外设计成本。本文提出一种新方法——基于模型内部表示的知识分析(KAMIR),通过分析模型各层隐藏状态与最终隐藏状态的相似性来评估数据。该方法不依赖提示工程,可广泛应用于机器阅读理解、摘要等任务。实验表明,使用较少熟悉的训练数据能显著提升模型泛化性能。

原文摘要 · Abstract (English)

Recent advances in large language models (LLMs) have been driven by pretraining, supervised fine tuning (SFT), and alignment tuning. Among these, SFT plays a crucial role in transforming a model 's general knowledge into structured responses tailored to specific tasks. However, there is no clearly established methodology for effective training data selection. Simply increasing the volume of data does not guarantee performance improvements, while preprocessing, sampling, and validation require substantial time and cost. To address this issue, a variety of data selection methods have been proposed. Among them, knowledge based selection approaches identify suitable training data by analyzing the model 's responses. Nevertheless, these methods typically rely on prompt engineering, making them sensitive to variations and incurring additional costs for prompt design. In this study, we propose Knowledge Analysis via Model Internal Representations (KAMIR), a novel approach that overcomes these limitations by analyzing data based on the model 's internal representations. KAMIR computes similarities between the hidden states of each layer (block) and the final hidden states for a given input to assess the data. Unlike prior methods that were largely limited to multiple choice tasks, KAMIR can be applied to a wide range of tasks such as machine reading comprehension and summarization. Moreover, it selects data useful for training based on the model 's familiarity with the input, even with a small dataset and a simple classifier architecture. Experiments across diverse task datasets demonstrate that training with less familiar data leads to better generalization performance.

模型分析数据选择泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。