让模型自动聚焦图像重要区域,提升效率与可解释性。
Learning Task-Aware Sampling with Shared Saliency through Density-Equalizing Mappings

- 用密度均衡映射动态调整卷积感受野,聚焦关键区域。
- 参数减少30%以上,图像分类与颅面分析性能更优。
- 适合医学影像等需关注局部病变的场景,结果可解释。
在基于图像和表面的学习任务中,卷积特征通常通过在整个域上均匀采样的感受野提取。然而,信息丰富的结构在实际中很少均匀分布,常集中在局部区域,尤其在医学影像中,病灶变化往往空间局限。因此,均匀卷积对有信息和无信息区域投入同等计算资源,导致特征提取效率低下,模型容量利用不充分。为解决此问题,我们提出一种任务自适应采样框架,根据数据空间重要性动态重分配计算注意力。具体地,引入密度均衡卷积神经网络(DECNN),通过学习的密度函数实现密度均衡映射,引导卷积操作。该密度函数编码不同区域的相对重要性,诱导一个将信息区域放大、非相关区域压缩的变换,使卷积感受野在域上非均匀分布,从而在任务相关区域实现更密集采样。结合重要性驱动的变换与卷积,DECNN实现自适应特征提取,将计算资源集中于信息结构。这提升了模型容量利用效率,形成轻量但表达力强的架构,同时生成可解释的显著图。在图像分类和颅面表面分析上的实验表明,DECNN以更少参数达到竞争性或更优性能,准确识别任务相关区域,并在复杂几何变化下保持鲁棒。
原文摘要 · Abstract (English)
In image and surface-based learning tasks, convolutional features are typically extracted using receptive fields that are sampled uniformly across the entire domain. However, informative structures are rarely distributed uniformly in practice and are often concentrated in localized regions. Such phenomena are particularly common in medical imaging, where pathological changes are spatially confined. Consequently, uniform convolution allocates equal computational effort to both informative and uninformative regions, resulting in inefficient feature extraction and suboptimal utilization of model capacity. To address this issue, we propose a framework for task-adaptive sampling that dynamically redistributes computational attention according to the spatial importance of the data. Specifically, we introduce the Density-Equalizing Convolutional Neural Network (DECNN), which employs density-equalizing mappings to guide convolution through a learned density function. The density function encodes the relative importance of different regions and induces a transformation that enlarges informative areas while compressing less relevant ones. As a result, convolutional receptive fields are redistributed non-uniformly over the domain, enabling denser sampling in task-relevant regions. By coupling this importance-driven transformation with convolution, DECNN performs adaptive feature extraction that focuses computational resources on informative structures. This leads to more efficient use of model capacity, yielding a lightweight yet expressive architecture while simultaneously producing an interpretable saliency map. Experiments on image classification and craniofacial surface analysis demonstrate that DECNN achieves competitive or superior performance with fewer parameters, accurately identifies task-relevant regions, and remains robust under complex geometric variations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。