用低密度数据训练模型,通过模拟实现高密度场景的准确计数。
L2HCount:Generalizing Crowd Counting from Low to High Crowd Density via Density Simulation
- 通过图像移位生成假高密度图像及标注,模拟密集人群模式。
- 在四个数据集上达到领先性能,最高误差低于1.8%。
- 适合无高密度标注但有低密度数据的计数场景。
自新冠疫情以来,人群计数任务应用广泛。尽管监督方法可靠,但在高密度场景中因头部尺寸小、遮挡严重而难以标注,而低密度场景则相对简单。有趣的是:能否在低密度场景训练模型并泛化到高密度场景?为此,我们提出低至高密度泛化框架L2HCount,从低密度样本中学习高密度模式,实现良好泛化。具体地,引入高密度模拟模块和真实标签生成模块,通过图像移位技术构建假高密度图像及其对应标注,有效模拟高密度人群特征。然而,模拟图像存在模糊和丢失低密度特征的问题。因此,我们进一步提出头特征增强模块,提取模拟高密度场景中的清晰特征。此外,设计双密度记忆编码模块,分别从低密度与模拟高密度场景中学习场景特异性模式。在四个挑战性数据集上的大量实验表明,L2HCount表现优异,最高误差低于1.8%。
原文摘要 · Abstract (English)
Since COVID-19, crowd-counting tasks have gained wide applications. While supervised methods are reliable, annotation is more challenging in high-density scenes due to small head sizes and severe occlusion, whereas it's simpler in low-density scenes. Interestingly, can we train the model in low-density scenes and generalize it to high-density scenes? Therefore, we propose a low- to high-density generalization framework (L2HCount) that learns the pattern related to high-density scenes from low-density ones, enabling it to generalize well to high-density scenes. Specifically, we first introduce a High-Density Simulation Module and a Ground-Truth Generation Module to construct fake high-density images along with their corresponding ground-truth crowd annotations respectively by image-shifting technique, effectively simulating high-density crowd patterns. However, the simulated images have two issues: image blurring and loss of low-density image characteristics. Therefore, we second propose a Head Feature Enhancement Module to extract clear features in the simulated high-density scene. Third, we propose a Dual-Density Memory Encoding Module that uses two crowd memories to learn scene-specific patterns from low- and simulated high-density scenes, respectively. Extensive experiments on four challenging datasets have shown the promising performance of L2HCount.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。