arXiv:2512.18301cs.CL2025-12被引 8

用XLNet提升多标签教程分类准确率,达97.3%。

InstructNet: A Novel Approach for Multi-Label Instruction Classification through Advanced Deep Learning

  • 基于XLNet与BERT等Transformer模型构建多标签分类框架。
  • 在wikiHow数据集上实现97.3%准确率,宏F1达93%。
  • 适合任务导向学习与知识库构建的研究者参考。

人们使用搜索引擎获取从日常用品到高阶专业物品的各类信息,其中‘如何’类查询已成为常见搜索模式,用于寻找完成特定任务的分步指导。对这类指令文本进行分类对任务导向学习和知识库构建至关重要。本研究以wikiHow上的11,121条‘如何’文章为数据集,每条记录包含多个类别标签,采用XLNet、BERT等基于Transformer的深度神经网络模型进行多标签分类。通过准确率与宏平均F1分数评估性能,结果表明所提InstructNet方法中XLNet表现最优,准确率达97.30%,微平均与宏平均F1分别为89.02%与93%。该高精度验证了XLNet在多标签指令分类中的有效性。多层级评估揭示了模型优势与改进空间。

原文摘要 · Abstract (English)

People use search engines for various topics and items, from daily essentials to more aspirational and specialized objects. Therefore, search engines have taken over as peoples preferred resource. The How To prefix has become familiar and widely used in various search styles to find solutions to particular problems. This search allows people to find sequential instructions by providing detailed guidelines to accomplish specific tasks. Categorizing instructional text is also essential for task-oriented learning and creating knowledge bases. This study uses the How To articles to determine the multi-label instruction category. We have brought this work with a dataset comprising 11,121 observations from wikiHow, where each record has multiple categories. To find out the multi-label category meticulously, we employ some transformer-based deep neural architectures, such as Generalized Autoregressive Pretraining for Language Understanding (XLNet), Bidirectional Encoder Representation from Transformers (BERT), etc. In our multi-label instruction classification process, we have reckoned our proposed architectures using accuracy and macro f1-score as the performance metrics. This thorough evaluation showed us much about our strategys strengths and drawbacks. Specifically, our implementation of the XLNet architecture has demonstrated unprecedented performance, achieving an accuracy of 97.30% and micro and macro average scores of 89.02% and 93%, a noteworthy accomplishment in multi-label classification. This high level of accuracy and macro average score is a testament to the effectiveness of the XLNet architecture in our proposed InstructNet approach. By employing a multi-level strategy in our evaluation process, we have gained a more comprehensive knowledge of the effectiveness of our proposed architectures and identified areas for forthcoming improvement and refinement.

多标签分类教程理解XLNetTransformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。