arXiv:2607.25465cs.CV2026-07

根据人群密度动态调整视频显著性,提升复杂场景下的注意力预测效果。

DensFiLM: Density-Conditioned Video Saliency for Crowd Scenes

论文配图:DensFiLM: Density-Conditioned Video Saliency for Crowd Scenes
图 1 · 摘自论文原文
  • 在Video Swin Transformer瓶颈层加入密度条件调制模块,实现注意力策略自适应
  • 在CrowdFix数据集上达到1.434的NSS和0.517的CC,优于ACLNet约15%
  • 仅增加10万参数,适合部署在资源受限的实时场景中

视频显著性模型通常对人群场景采用统一的注视策略,但注意力随人群密度系统性变化:稀疏场景关注个体追踪,密集场景则转向集体运动和场景级地标。我们提出DensFiLM,一种基于密度条件的视频显著性模型,在Video Swin Transformer的瓶颈层插入轻量级特征逐通道线性调制(FiLM)模块。通过学习的密度嵌入生成通道尺度与偏移参数,使解码器能根据不同密度区间选择合适特征重建显著图。该模块仅增加约10万参数,可使用CrowdFix标注密度或模型自身预测密度。在CrowdFix上,DensFiLM在四个种子下取得均值NSS 1.434、CC 0.517,相比ACLNet分别提升14.7%和14.9%;预测密度条件性能接近真值标签。消融实验表明,显式使用RAFT光流及扩展时空与社会力机制未带来进一步提升。中心先验减法诊断显示,密度条件使NSS提升0.462,远超无条件基线的0.124。结果表明,轻量级瓶颈条件化比增大模型容量更有效提升人群视频显著性建模。

原文摘要 · Abstract (English)

Video saliency models typically apply a single fixation strategy across crowd scenes, despite systematic changes in attention with crowd density. Sparse scenes encourage tracking individuals, whereas dense scenes shift attention toward collective motion and scene-level landmarks. We introduce DensFiLM, a density-conditioned video saliency model that inserts a lightweight Feature-wise Linear Modulation layer at the bottleneck of a Video Swin Transformer. A learned density embedding produces channel-wise scale and shift parameters, allowing the decoder to reconstruct saliency from features selected for each density regime. The module adds only ~100K parameters and can use either CrowdFix density labels or the model's own density prediction. On CrowdFix, DensFiLM achieves mean NSS 1.434 and CC 0.517 over four seeds, improving over ACLNet by 14.7% and 14.9%, respectively, while predicted-density conditioning matches oracle-label performance. Ablations show that explicit RAFT optical flow and larger temporal and social-force extensions provide no further improvement in this setting. In a centre-prior-subtraction diagnostic, density conditioning yields an NSS gain of 0.462 over the unconditioned backbone, compared with 0.124 under standard evaluation. These results show that lightweight bottleneck conditioning provides a more effective inductive bias than increasing model capacity for crowd-video saliency. Our code is available at https://github.com/aniskhan25/crowdfix-saliency.

视频显著性人群密度注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。