arXiv:2606.03576cs.CL2026-06

针对中文论文分类中标签不平衡问题,提出自适应调整训练目标的新方法。

AutoTail-BSFGM: Class-Balance-Aware Fine-Tuning for Chinese Scholarly Text Classification

论文配图:AutoTail-BSFGM: Class-Balance-Aware Fine-Tuning for Chinese Scholarly Text Classification
图 1 · 摘自论文原文
  • 通过自动门控尾部修正与平衡Softmax损失,动态优化类别不平衡问题。
  • 在67类抽象分类任务中,准确率提升0.83个百分点,验证集显著改善(p=0.023)。
  • 适合处理标签不均衡的中文学术文本分类,尤其对细粒度类别敏感场景有效。

学术文本分类支持文献组织、主题标引与研究智能,但中文学术语料常存在标签不平衡和语义相近的学科标签问题。本文提出AutoTail-BSFGM,一种关注类别平衡的微调方法,结合自动门控尾部先验调整、弱平衡Softmax辅助损失与快速梯度法对抗正则化。该方法仅修改训练目标与流程,推理时仍使用与对应标签平滑基线相同的单个基础规模编码器和线性分类器。在两个基于CSL的任务上评估:包含67个标签的摘要到学科分类任务,以及13个类别的标题到类别任务。在主要摘要任务中,AutoTail-BSFGM在Chinese RoBERTa-WWM与MacBERT-base上均提升了验证集与锁箱准确率。使用MacBERT-base时,验证准确率提升0.83个百分点,锁箱准确率提升0.49点,验证集成对McNemar检验结果显著(p=0.023)。在标题任务中,验证准确率提升0.70点,验证平衡准确率提升2.64点;锁箱准确率变化不大,锁箱平衡准确率提升1.22点。结果表明其贡献有限且有边界:能改善类别平衡敏感行为,在基于摘要的学术分类中表现稳定增益,但并非在所有指标和划分上都一致提升。

原文摘要 · Abstract (English)

Scholarly text classification supports literature organization, subject indexing, and research intelligence, but Chinese scholarly corpora often contain imbalanced and semantically adjacent disciplinary labels. We propose AutoTail-BSFGM, a class-balance-aware fine-tuning method that combines an automatically gated tail-prior adjustment, a weak Balanced Softmax auxiliary loss, and Fast Gradient Method adversarial regularization. The method changes only the training objective and procedure; inference uses the same single base-size encoder and linear classifier as the corresponding label-smoothed baseline. We evaluate the method on two CSL-based tasks: an abstract-to-discipline task with 67 labels and a title-to-category task with 13 categories. On the primary abstract task, AutoTail-BSFGM improves validation and lockbox accuracy under both Chinese RoBERTa-WWM and MacBERT-base. With MacBERT-base, validation accuracy increases by 0.83 percentage points and lockbox accuracy by 0.49 points, with a pooled paired McNemar signal on validation (p = 0.023). On the title task, the method improves validation accuracy by 0.70 points and validation balanced accuracy by 2.64 points; lockbox accuracy is approximately neutral while lockbox balanced accuracy improves by 1.22 points. The results support a bounded contribution: AutoTail-BSFGM improves class-balance-sensitive behavior and yields consistent gains for abstract-based scholarly classification, without uniformly improving every metric on every split.

文本分类标签平衡中文NLP微调方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。