arXiv:2604.27335cs.CV2026-04中稿 · CVPR

用大模型迭代优化分类定义,提升零样本网页内容识别准确率

Iterative Definition Refinement for Zero-Shot Classification via LLM-Based Semantic Prototype Optimization

论文配图:Iterative Definition Refinement for Zero-Shot Classification via LLM-Based Semantic Prototype Optimization
图 1 · 摘自论文原文
  • 通过大模型自动修正类别描述,不更新模型参数
  • 在13个主流模型上提升分类性能,最高达18.7%准确率增益
  • 适合需要快速适配新类别的安全系统部署

网络过滤系统依赖精准的内容分类来阻止网络威胁、防止数据外泄并确保合规。然而,现代网络的动态性使分类愈发困难。基于嵌入的零样本方法将内容与类别描述映射到共享语义空间,实现无需标注数据的标签分配,但对定义质量高度敏感。定义不清或模糊会导致嵌入空间中语义重叠,引发系统性误判。本文提出一种无需训练、可自适应迭代优化的定义改进框架,通过大模型作为反馈驱动的定义优化器,探索三种策略:示例引导、混淆感知和历史感知,分别利用误分类样本的结构化信号优化类别描述。我们构建了一个包含10个URL类别的标注基准数据集,每类1,000样本,并在13个最先进的嵌入式基础模型上进行评估。结果表明,迭代定义优化在多种架构上均持续提升分类性能,确立了定义质量是嵌入式系统中关键且未被充分重视的因素。数据集已公开于 https://github.com/naeemrehmat/B2MWT-10C。

原文摘要 · Abstract (English)

Web filtering systems rely on accurate web content classification to block cyber threats, prevent data exfiltration, and ensure compliance. However, classification is increasingly difficult due to the dynamic and rapidly evolving nature of the modern web. Embedding-based zero-shot approaches map content and category descriptions into a shared semantic space, enabling label assignment without labeled training data, but remain highly sensitive to definition quality. Poorly specified or ambiguous definitions create semantic overlap in the embedding space, leading to systematic misclassification. In this paper, we propose a training-free, adaptive iterative definition refinement framework that improves zero-shot web content classification by progressively optimizing category definitions rather than updating model parameters. Using LLMs as feedback-driven definition optimizers, we investigate three refinement strategies namely example-guided, confusion-aware, and history-aware, each refining class descriptions using structured signals from misclassified instances. Furthermore, we introduce a human-labeled benchmark of 10 URL categories with 1,000 samples per class and evaluate across 13 state-of-the-art embedding foundation models. Results demonstrate that iterative definition refinement consistently improves classification performance across diverse architectures, establishing definition quality as a critical and underexplored factor in embedding-based systems. The dataset is available at https://github.com/naeemrehmat/B2MWT-10C.

零样本分类大模型应用文本安全定义优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。