用重述与对比方法,让大模型更好理解网络通信原理。
Rephrase and Contrast: Fine-Tuning Language Models for Enhanced Understanding of Communication and Computer Networks
- 通过重写问题和对比正误答案来提升模型理解力。
- 在综合网络题集上准确率比基础模型高63.73%。
- 适合网络研究者与轻量级模型应用开发者使用。
大型语言模型(LLMs)在多个领域受到广泛关注,尤其在理解通信网络运行机制方面投入大量研究。然而,过度依赖提示技术限制了模型泛化能力的发挥,且缺乏高效的微调方法,阻碍了轻量级LLM潜力的实现。本文提出一种名为重述与对比(RaC)的高效微调框架,通过在微调过程中引入问题重述和正确与错误答案的对比分析,增强模型的理解与批判性思维能力。实验结果表明,在综合性网络问题集上,该方法相比基础模型准确率提升63.73%。为高效构建训练数据集,我们开发了基于GPT的数据挖掘方法以生成高质量问答对;同时提出ChoiceBoost数据增强技术,扩大数据规模并减少答案顺序偏差。此外,我们向社区开源四项重要资源:1)名为RaC-Net的微调后网络模型;2)用于微调的训练数据集;3)三套难度不同的测试题集,作为未来研究基准;4)相关代码。
原文摘要 · Abstract (English)
Large language models (LLMs) are being widely researched across various disciplines, with significant recent efforts focusing on adapting LLMs for understanding of how communication networks operate. However, over-reliance on prompting techniques hinders the full exploitation of the generalization ability of these models, and the lack of efficient fine-tuning methods prevents the full realization of lightweight LLMs' potential. This paper addresses these challenges by introducing our Rephrase and Contrast (RaC) framework, an efficient fine-tuning framework. RaC enhances LLMs' comprehension and critical thinking abilities by incorporating question reformulation and contrastive analysis of correct and incorrect answers during the fine-tuning process. Experimental results demonstrate a 63.73% accuracy improvement over the foundational model when tested on a comprehensive networking problem set. Moreover, to efficiently construct the dataset for RaC fine-tuning, we develop a GPT-assisted data mining method for generating high-quality question-answer (QA) pairs; furthermore, we introduce ChoiceBoost, a data augmentation technique that expands dataset size while reducing answer-order bias. Apart from these technical innovations, we contribute to the networking community by open-sourcing valuable research resources, including: 1) the fine-tuned networking model referred to as RaC-Net, 2) the training dataset used for fine-tuning the model, 3) three testing problem sets of different difficulties to serve as benchmarks for future research, and 4) code associated with the above resources.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。