arXiv:2504.19592cs.CVcs.AI2025-04

通过限制类别空间让神经网络专注特定任务,提升性能且无需额外数据。

Neural network task specialization via domain constraining

  • 限定网络只处理特定类别子集,实现任务专业化。
  • 仅靠约束类别空间,通用模型准确率即可提升。
  • 适合需要动态配置或排除特定数据域的场景。

本文提出通过任务特定的领域约束实现神经网络专业化,旨在提升网络在特定数据子空间上的表现。实验针对图像分类和目标检测任务展开,结果表明:仅通过限制网络所处理的类别标签空间,即可在不增加数据或改变训练方式的情况下,提升通用模型的准确率。理论与实验证明,有效专业化需改进传统微调方法,并将数据空间约束在语义连贯的子集内。论文提出在微调前进行专家提取阶段以获得最大性能增益,并分析了专业化过程中特征空间的演化。该研究为未来开发可根据输入动态配置的图像分析系统奠定基础,同时适用于需排除特定数据域的场景。

原文摘要 · Abstract (English)

This paper introduces a concept of neural network specialization via task-specific domain constraining, aimed at enhancing network performance on data subspace in which the network operates. The study presents experiments on training specialists for image classification and object detection tasks. The results demonstrate that specialization can enhance a generalist's accuracy even without additional data or changing training regimes: solely by constraining class label space in which the network performs. Theoretical and experimental analyses indicate that effective specialization requires modifying traditional fine-tuning methods and constraining data space to semantically coherent subsets. The specialist extraction phase before tuning the network is proposed for maximal performance gains. We also provide analysis of the evolution of the feature space during specialization. This study paves way to future research for developing more advanced dynamically configurable image analysis systems, where computations depend on the specific input. Additionally, the proposed methods can help improve system performance in scenarios where certain data domains should be excluded from consideration of the generalist network.

神经网络任务专业化图像分类特征空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。