用神经元激活模式选关键样本,让大模型少标注多见效。
Neuron-Aware Active Few-Shot Learning for LLMs

- 基于神经元激活模式选样本,比看输出更懂模型内部问题。
- 在三个数据集上表现优于现有方法,推理与分类任务都更好。
- 适合想降低标注成本又提升性能的模型调优人员。
主动小样本学习(AFSL)通过识别最有价值的未标注样本进行标注和少样本示范,帮助大模型适应专业领域,在降低人工标注成本的同时保持高性能。然而,现有方法多依赖输出层面信号(如预测熵或与测试数据的语义相似性)进行样本选择,常忽略模型内部动态,难以精准定位知识盲区。为此,本文提出NeuFS——一种基于神经元感知的主动小样本学习框架,将选择范式从输出层面代理转向模型内部动态。NeuFS利用神经元激活模式直接表征样本,并设计双准则策略:(1) 通过神经元模式确保少样本样本多样性,覆盖更广;(2) 量化神经元共识度,优先选出大模型易幻觉的高信息量挑战样本。在三个数据集上的实验表明,NeuFS在推理与文本分类任务中均优于现有基线。消融研究进一步验证,内部神经元激活比外部嵌入提供了更合理、有效的选择信号,证明了NeuFS的优越性。
原文摘要 · Abstract (English)
Active Few-Shot Learning (AFSL) adapts LLMs to specialized domains by identifying the most valuable unlabeled samples for annotation and use as few-shot demonstrations, effectively reducing human annotation costs while promoting high performance. However, existing methods typically rely on output-level signals for sample identification, such as predictive entropy or semantic similarities with test-time data based on external embeddings, which often overlook models' internal dynamics, which could pinpoint specific knowledge gaps. To bridge this gap, we propose NeuFS, a Neuron-Aware Active Few-Shot Learning framework that shifts the selection paradigm from output-level proxies to models' internal dynamics. NeuFS utilizes neuron activation patterns to represent sample directly, and includes a dual-criteria selection strategy that: (1) ensures few-shot sample diversity with neuron patterns for broader example coverage, while (2) prioritizing on identifying informative and challenging few-shot samples LLMs tend to hallucinate by quantifying neuron consensus. Experiments on three datasets demonstrate that NeuFS excels in both reasoning and text classification tasks, outperforming existing AFSL baselines. Ablation studies further highlight that internal neuron activations provide a more principled and effective selection signal than external embeddings, validating the superiority of the proposed NeuFS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。