arXiv:2602.23753cs.CL2026-02被引 3

通过结构化提示优化,提升少样本文本分类的语义清晰度与准确性。

Structured Prompt Optimization for Few-Shot Text Classification via Semantic Alignment in Latent Space

  • 设计多维度结构提示,融合文本特征生成可区分的潜在表示。
  • 在低资源下实现准确率、召回率与AUC的显著提升。
  • 适合需要可控、透明分类决策的少样本场景应用。

针对少样本文本分类中语义纠缠、标签结构模糊和特征表达不足的问题,本文提出一种基于结构化提示的优化框架,以增强低资源条件下的语义理解与任务适应能力。该框架首先利用预训练语言模型编码输入文本,获得基础语义表示;随后引入由多维语义因子构成的结构化提示,通过可学习组合机制将其与文本特征融合,在潜在空间中形成具有清晰边界的任务相关表示。为强化文本表示与标签语义的一致性,方法构建结构化标签嵌入矩阵,并采用跨空间对齐机制确保文本特征与标签属性的稳定匹配。此外,通过提示正交性约束与联合优化目标,保持提示中不同语义因子的独立性,使结构化提示能提供透明且可控的分类指导。设计了三种敏感性实验(学习率、提示长度、数据规模),验证框架在不同条件下的稳定性与鲁棒性。实验结果表明,所提框架有效缓解了语义冲突与标签模糊问题,在准确率、精确率、召回率和AUC上均有显著提升,具备良好的跨任务适用性。

原文摘要 · Abstract (English)

This study addresses the issues of semantic entanglement, unclear label structure, and insufficient feature representation in few-shot text classification, and proposes an optimization framework based on structured prompts to enhance semantic understanding and task adaptation under low-resource conditions. The framework first uses a pretrained language model to encode the input text and obtain basic semantic representations. It then introduces structured prompts composed of multi-dimensional semantic factors and integrates them with text features through a learnable combination mechanism, which forms task-related representations with clear boundaries in the latent space. To further strengthen the consistency between text representations and label semantics, the method constructs a structured label embedding matrix and employs a cross-space alignment mechanism to ensure stable matching between textual features and label attributes. In addition, the model applies prompt orthogonality constraints and a joint optimization objective to maintain independence across different semantic factors in the prompts, allowing the structured prompts to provide transparent and controllable guidance for classification decisions. Three types of sensitivity experiments, including learning rate sensitivity, prompt length sensitivity, and data scale sensitivity, are designed to evaluate the stability and robustness of the framework under different conditions. Experimental results show that the proposed structured prompt optimization framework effectively alleviates semantic conflicts and label ambiguity in few-shot text classification. It significantly improves performance on accuracy, precision, recall, and AUC, and demonstrates strong cross-task applicability.

少样本分类提示优化语义对齐潜在空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。