arXiv:2503.08531cs.CVq-bio.QM2025-03被引 1

用注意力图建模人类视觉行为,更准确捕捉共同注视模式。

Visual Attention Graph

  • 构建基于语义的注意力图,融合显著性与注视路径
  • 在多个数据集上提升注视预测性能,优于传统方法
  • 可用于自闭症筛查与年龄识别等认知状态评估

视觉注意力在主动视觉任务中起关键作用。现有方法多依赖原始注视点或注视路径数据,但缺乏场景语义信息,导致个体间和个体内差异大,难以捕捉共性注意模式。为此,本文提出一种新的注意力表示——注意力图(Attention Graph),以图结构同时编码视觉显著性与注视路径:节点代表语义对象,边表示注视转移,节点上的注视密度反映对象显著性。系统实验表明,该方法结合新评估指标能更优地衡量注意力预测模型性能;额外实验显示其在自闭症谱系障碍筛查与年龄分类等认知状态评估中具有潜力。

原文摘要 · Abstract (English)

Visual attention plays a critical role when our visual system executes active visual tasks by interacting with the physical scene. However, how to encode the visual object relationship in the psychological world of our brain deserves to be explored. In the field of computer vision, predicting visual fixations or scanpaths is a usual way to explore the visual attention and behaviors of human observers when viewing a scene. Most existing methods encode visual attention using individual fixations or scanpaths based on the raw gaze shift data collected from human observers. This may not capture the common attention pattern well, because without considering the semantic information of the viewed scene, raw gaze shift data alone contain high inter- and intra-observer variability. To address this issue, we propose a new attention representation, called Attention Graph, to simultaneously code the visual saliency and scanpath in a graph-based representation and better reveal the common attention behavior of human observers. In the attention graph, the semantic-based scanpath is defined by the path on the graph, while saliency of objects can be obtained by computing fixation density on each node. Systemic experiments demonstrate that the proposed attention graph combined with our new evaluation metrics provides a better benchmark for evaluating attention prediction methods. Meanwhile, extra experiments demonstrate the promising potentials of the proposed attention graph in assessing human cognitive states, such as autism spectrum disorder screening and age classification.

注意力图视觉注意认知评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。