arXiv:2505.16227cs.CLcs.AI2025-05

用少量标注数据实现个性化术语识别,效率远超GPT-4。

Explain Less, Understand More: Jargon Detection via Personalized Parameter-Efficient Fine-tuning

  • 采用轻量微调LoRA与个性化提示结合策略
  • 仅用10%数据即达最优基线性能,F1提升21.4%
  • 适合资源有限但需个性化技术文档理解的场景

个性化术语检测对提升跨领域技术文档可读性至关重要。现有方法通常需大量标注数据和计算资源。本文系统研究高效可扩展的个性化术语检测方法,提出两种策略:一是在开源模型上使用低秩适配(LoRA)进行轻量微调;二是在推理时通过个性化提示调整模型行为。为贴近实际,还探索了结合少量标注数据与自监督学习的半监督方案。实验显示,个性化LoRA模型在F1上比带上下文提示的GPT-4高出21.4%,优于最佳基准8.3%。尤为关键的是,该方法仅需10%训练数据即可达到接近全量数据的效果,证明其在资源受限场景下的实用性。本工作首次系统探索基于开源语言模型的低资源个性化术语检测,为可扩展、用户自适应NLP系统提供可行路径。

原文摘要 · Abstract (English)

Personalizing jargon detection and explanation is essential for making technical documents accessible to readers with diverse disciplinary backgrounds. However, tailoring models to individual users typically requires substantial annotation efforts and computational resources due to user-specific finetuning. To address this, we present a systematic study of personalized jargon detection, focusing on methods that are both efficient and scalable for real-world deployment. We explore two personalization strategies: (1) lightweight finetuning using Low-Rank Adaptation (LoRA) on open-source models, and (2) personalized prompting, which tailors model behavior at inference time without retaining. To reflect realistic constraints, we also investigate semi-supervised approaches that combine limited annotated data with self-supervised learning from users' publications. Our personalized LoRA model outperforms GPT-4 with contextual prompting by 21.4% in F1 score and exceeds the best performing oracle baseline by 8.3%. Remarkably, our method achieves comparable performance using only 10% of the annotated training data, demonstrating its practicality for resource-constrained settings. Our study offers the first work to systematically explore efficient, low-resource personalization of jargon detection using open-source language models, offering a practical path toward scalable, user-adaptive NLP system.

术语检测个性化LoRA低资源

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。