arXiv:2601.21933cs.CV2026-01被引 3

为深度视觉特征设计可感知的扰动边界,提升模型在资源受限下的性能表现。

Just Noticeable Difference Modeling for Deep Visual Features

  • 提出FeatJND模型,量化每维特征可容忍的最大扰动范围。
  • 在分类、检测等任务中,扰动后性能优于随机高斯噪声。
  • 适用于动态量化,能指导更优的量化步长分配策略。

深度视觉特征正越来越多地作为视觉系统的核心接口,因此需要描述其特性并控制特征质量以保障机器感知性能。可见差异(Just Noticeable Difference, JND)描述了在人类或机器视觉下图像允许的最大不可察觉失真。将JND扩展至深度特征空间,可自然提供任务对齐的容差边界,为资源受限场景下的特征质量控制提供实用参考。本文提出一种任务对齐的JND建模方法FeatJND,可预测在保持下游任务性能前提下的每维特征最大可容忍扰动图。我们在图像分类、目标检测和实例分割任务上验证该方法的有效性。在相同失真强度下,基于FeatJND的扰动始终比无结构的高斯扰动保留更高任务性能,且特征归因可视化显示其能抑制非关键特征区域。进一步应用中,我们将FeatJND用于逐令牌动态量化,结果表明,在相同噪声预算下,由FeatJND引导的步长分配显著优于随机排列和全局均匀步长。

原文摘要 · Abstract (English)

Deep visual features are increasingly used as the interface in vision systems, motivating the need to describe feature characteristics and control feature quality for machine perception. Just noticeable difference (JND) characterizes the maximum imperceptible distortion for images under human or machine vision. Extending it to deep visual features naturally meets the above demand by providing a task-aligned tolerance boundary in feature space, offering a practical reference for controlling feature quality under constrained resources. We propose FeatJND, a task-aligned JND formulation that predicts the maximum tolerable per-feature perturbation map while preserving downstream task performance. We propose a FeatJND estimator at standardized split points and validate it across image classification, detection, and instance segmentation. Under matched distortion strength, FeatJND-based distortions consistently preserve higher task performance than unstructured Gaussian perturbations, and attribution visualizations suggest FeatJND can suppress non-critical feature regions. As an application, we further apply FeatJND to token-wise dynamic quantization and show that FeatJND-guided step-size allocation yields clear gains over random step-size permutation and global uniform step size under the same noise budget. Our code will be released after publication.

特征质量动态量化深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。