用知识图谱让盲人导航系统快速生成可理解的提示。
Cognitively-Inspired Emergent Communication via Knowledge Graphs for Assisting the Visually Impaired
- 构建知识图谱模拟人类认知,优先关注关键物体。
- 在不同词汇量下,比传统方法更接近人类地图相似度。
- 适合需要实时、可解释反馈的无障碍辅助系统开发。
为视障人士设计的辅助系统需在实时导航中提供快速、可解释且自适应的反馈。当前方法在延迟与语义丰富性之间存在权衡:基于自然语言的系统虽信息详尽但速度慢,而新兴通信框架虽延迟低却缺乏语义深度,难以应用于触觉模态如振动。为此,我们提出一种新框架——基于知识图谱的认知启发式新兴通信(VAG-EC),模拟人类视觉感知与认知映射。该方法通过知识图谱表示物体及其关系,并引入注意力机制聚焦任务相关实体,类比人类选择性注意。这种结构化方式促成了紧凑、可解释且上下文敏感的符号语言。在不同词汇量和消息长度下的实验表明,VAG-EC在拓扑相似性(TopSim)和上下文独立性(CI)上均优于传统新兴通信方法。结果表明,基于认知基础的新兴通信是实现实时、自适应、符合人类直觉的辅助技术的有效方案。代码已公开于 https://github.com/Anonymous-NLPcode/Anonymous_submission/tree/main。
原文摘要 · Abstract (English)
Assistive systems for visually impaired individuals must deliver rapid, interpretable, and adaptive feedback to facilitate real-time navigation. Current approaches face a trade-off between latency and semantic richness: natural language-based systems provide detailed guidance but are too slow for dynamic scenarios, while emergent communication frameworks offer low-latency symbolic languages but lack semantic depth, limiting their utility in tactile modalities like vibration. To address these limitations, we introduce a novel framework, Cognitively-Inspired Emergent Communication via Knowledge Graphs (VAG-EC), which emulates human visual perception and cognitive mapping. Our method constructs knowledge graphs to represent objects and their relationships, incorporating attention mechanisms to prioritize task-relevant entities, thereby mirroring human selective attention. This structured approach enables the emergence of compact, interpretable, and context-sensitive symbolic languages. Extensive experiments across varying vocabulary sizes and message lengths demonstrate that VAG-EC outperforms traditional emergent communication methods in Topographic Similarity (TopSim) and Context Independence (CI). These findings underscore the potential of cognitively grounded emergent communication as a fast, adaptive, and human-aligned solution for real-time assistive technologies. Code is available at https://github.com/Anonymous-NLPcode/Anonymous_submission/tree/main.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。