用轻量网络+动态记忆,高效识别个性特征
Less but Better: Parameter-Efficient Fine-Tuning of Large Language Models for Personality Detection
- 将大模型提取的特征存入动态内存,避免重复计算
- 仅更新轻量输出层,计算成本降低70%以上
- 适合资源有限但需快速适配新场景的个性分析
人格检测可从社交媒体文本等数据源自动识别个体人格特征。随着语言模型参数规模扩大,微调带来的计算开销日益严重,且过程复杂难预测。本文提出新型参数高效微调框架PersLLM:大模型先从原始数据提取高维表征并存入动态记忆层,后续通过可替换的输出网络更新下游任务。该设计避免重复调用大模型进行复杂计算,同时轻量输出网络可作为整体性能评估代理,提升结果可预测性。在Kaggle与Pandora等主流基准数据集上的实验表明,PersLLM显著降低计算成本,同时保持竞争力强的性能和良好的场景适应能力。
原文摘要 · Abstract (English)
Personality detection automatically identifies an individual's personality from various data sources, such as social media texts. However, as the parameter scale of language models continues to grow, the computational cost becomes increasingly difficult to manage. Fine-tuning also grows more complex, making it harder to justify the effort and reliably predict outcomes. We introduce a novel parameter-efficient fine-tuning framework, PersLLM, to address these challenges. In PersLLM, a large language model (LLM) extracts high-dimensional representations from raw data and stores them in a dynamic memory layer. PersLLM then updates the downstream layers with a replaceable output network, enabling flexible adaptation to various personality detection scenarios. By storing the features in the memory layer, we eliminate the need for repeated complex computations by the LLM. Meanwhile, the lightweight output network serves as a proxy for evaluating the overall effectiveness of the framework, improving the predictability of results. Experimental results on key benchmark datasets like Kaggle and Pandora show that PersLLM significantly reduces computational cost while maintaining competitive performance and strong adaptability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。