通过语义与元标签优化,提升教育问答多标签分类准确率
Leveraging Label Semantics and Meta-Label Refinement for Multi-Label Question Classification
- 利用标签语义关系改进预训练,增强标签区分能力
- 在多个数据集上精度和F1分数均优于现有方法
- 适合处理长尾标签,对在线教育推荐系统有实用价值
精准标注在线教育资源对个性化学习和资源推荐至关重要。然而,细粒度知识标签常存在重叠或相似性,且人工标注稀疏导致标签分布不均衡,使现有多标签分类方法难以区分。为此,本文提出RR2QC:一种基于标签语义与元标签精炼的检索重排序多标签问答分类方法。首先,通过利用标签组内及组间语义关系改进预训练策略;其次,在下游训练中引入类别中心学习任务,使问题与标签语义对齐;最后,将标签分解为元标签,通过元标签分类器重排序检索到的标签序列。该方法通过频繁共现的元标签学习,提升了对长尾标签的理解与预测能力。此外,借助数学大模型生成问题解法,提取潜在信息以进一步优化模型洞察。实验表明,RR2QC在多个教育数据集上的Precision@K和F1分数均优于现有方法,验证了其在在线教育应用中的有效性。代码与数据集已公开于https://github.com/78Erii/RR2QC。
原文摘要 · Abstract (English)
Accurate annotation of educational resources is crucial for effective personalized learning and resource recommendation in online education. However, fine-grained knowledge labels often overlap or share similarities, making it difficult for existing multi-label classification methods to differentiate them. The label distribution imbalance due to sparsity of human annotations further intensifies these challenges. To address these issues, this paper introduces RR2QC, a novel Retrieval Reranking method to multi-label Question Classification by leveraging label semantics and meta-label refinement. First, RR2QC improves the pre-training strategy by utilizing semantic relationships within and across label groups. Second, it introduces a class center learning task to align questions with label semantics during downstream training. Finally, this method decomposes labels into meta-labels and uses a meta-label classifier to rerank the retrieved label sequences. In doing so, RR2QC enhances the understanding and prediction capability of long-tail labels by learning from meta-labels that frequently appear in other labels. Additionally, a mathematical LLM is used to generate solutions for questions, extracting latent information to further refine the model's insights. Experimental results show that RR2QC outperforms existing methods in Precision@K and F1 scores across multiple educational datasets, demonstrating its effectiveness for online education applications. The code and datasets are available at https://github.com/78Erii/RR2QC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。