arXiv:2511.03034cs.CLcs.LG2025-11

提出新评估方法与小模型适配方案,让教育领域情感分析用更少数据跑出好效果。

Data-Efficient Adaptation and a Novel Evaluation Method for Aspect-based Sentiment Analysis

  • 设计灵活匹配算法,容忍边界误差,更真实评价生成式模型表现。
  • 用200-1000条数据训练<7B参数小模型,性能超越大厂闭源模型。
  • 首次开源教育评论数据集,助力低资源领域研究落地。

方面级情感分析(ABSA)是一种细粒度意见挖掘方法,用于识别和分类句子中特定实体或类别的情感。尽管发展迅速,现有研究仍集中于商业领域,难以满足教育、医疗等高需求但低资源领域的分析需求。传统方法依赖大量训练知识注入,且评估方式过于严格,基于精确匹配会惩罚合理边界差异,导致生成模型性能被低估。本文提出三项贡献:1)提出柔性文本相似度匹配与最优二分匹配(FTS-OBP)评估方法,可容纳真实提取边界波动,保持与传统指标强相关性并提供细粒度诊断;2)首次系统研究小于70亿参数的解码器仅模型(SLMs)在教育评论中的应用,通过无数据(上下文学习、权重合并)和轻量微调方法探索资源下限,并提出多任务微调策略,使1.5–3.8亿参数模型仅需200–1000个样本,在单张GPU上即可超越商用大模型,接近基准结果;3)发布首个公开的教育评论ABSA资源集,推动低资源领域研究发展。

原文摘要 · Abstract (English)

Aspect-based Sentiment Analysis (ABSA) is a fine-grained opinion mining approach that identifies and classifies opinions associated with specific entities (aspects) or their categories within a sentence. Despite its rapid growth and broad potential, ABSA research and resources remain concentrated in commercial domains, leaving analytical needs unmet in high-demand yet low-resource areas such as education and healthcare. Domain adaptation challenges and most existing methods' reliance on resource-intensive in-training knowledge injection further hinder progress in these areas. Moreover, traditional evaluation methods based on exact matches are overly rigid for ABSA tasks, penalising any boundary variations which may misrepresent the performance of generative models. This work addresses these gaps through three contributions: 1) We propose a novel evaluation method, Flexible Text Similarity Matching and Optimal Bipartite Pairing (FTS-OBP), which accommodates realistic extraction boundary variations while maintaining strong correlation with traditional metrics and offering fine-grained diagnostics. 2) We present the first ABSA study of small decoder-only generative language models (SLMs; <7B parameters), examining resource lower bounds via a case study in education review ABSA. We systematically explore data-free (in-context learning and weight merging) and data-light fine-tuning methods, and propose a multitask fine-tuning strategy that significantly enhances SLM performance, enabling 1.5-3.8 B models to surpass proprietary large models and approach benchmark results with only 200-1,000 examples on a single GPU. 3) We release the first public set of education review ABSA resources to support future research in low-resource domains.

情感分析小模型低资源教育数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。