arXiv:2505.12792cs.CL2025-05IJCAI被引 5

用小模型预判文本价值,大幅减少大模型输入量,提升效率与准确率。

EAVIT: Efficient and Accurate Human Value Identification from Text data via LLMs

  • 小模型先预判价值,生成精简提示词
  • 输入令牌数减少1/6,准确率优于传统方法
  • 适合需要高效处理长文本价值识别的场景

大型语言模型(LLMs)的快速发展已推动文本中人类价值观识别的进步。尽管传统NLP模型如BERT已被用于此任务,但其文本表征能力远逊于GPT等新兴大模型。然而,在线大模型在处理长文本时性能下降且计算成本高昂。为此,我们提出EAVIT框架,融合本地可微调与在线黑盒大模型的优势。该框架采用一个小型本地语言模型作为价值检测器,生成初步价值估计,并据此构建简洁提示词输入在线大模型,实现精准最终识别。为训练检测器,我们引入基于解释的训练与数据生成方法,并设计采样策略以优化提示词长度。相比直接查询在线大模型,本方法最多减少1/6的输入令牌数,且持续优于传统NLP方法与其他基于大模型的策略。

原文摘要 · Abstract (English)

The rapid evolution of large language models (LLMs) has revolutionized various fields, including the identification and discovery of human values within text data. While traditional NLP models, such as BERT, have been employed for this task, their ability to represent textual data is significantly outperformed by emerging LLMs like GPTs. However, the performance of online LLMs often degrades when handling long contexts required for value identification, which also incurs substantial computational costs. To address these challenges, we propose EAVIT, an efficient and accurate framework for human value identification that combines the strengths of both locally fine-tunable and online black-box LLMs. Our framework employs a value detector - a small, local language model - to generate initial value estimations. These estimations are then used to construct concise input prompts for online LLMs, enabling accurate final value identification. To train the value detector, we introduce explanation-based training and data generation techniques specifically tailored for value identification, alongside sampling strategies to optimize the brevity of LLM input prompts. Our approach effectively reduces the number of input tokens by up to 1/6 compared to directly querying online LLMs, while consistently outperforming traditional NLP methods and other LLM-based strategies.

价值观识别大模型优化提示工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。