用AI助盲人士自助逛超市，靠视觉识别和语音导航找商品
An AI-Based Shopping Assistant System to Support the Visually Impaired
- 结合计算机视觉与语音技术，通过标记识别实现室内导航
- 实测表明系统能有效引导用户并提升购物体验
- 适合无障碍设计、智能助残领域研究者参考
购物对塑造消费者身份和社会融入具有重要意义。然而，视障人士在超市中导航和识别商品时面临巨大挑战。本文提出一种基于人工智能的购物助手原型系统，旨在提升视障人士在超市环境中的自主性与包容性。该系统融合计算机视觉、语音识别、文本转语音及室内导航技术，形成一体化用户友好平台。通过摄像头检测ArUco标记并实时扫描环境，系统可帮助用户定位商品、提供实时语音指引，并获取周围环境信息。助手通过语音指令与多模态反馈与用户交互，增强购物过程的动态性与参与感。实验评估显示，该系统能有效引导用户，显著改善其购物体验。本研究推动了面向购物场景的包容性AI辅助技术发展，助力提升视障人群的独立性与可及性。
原文摘要 · Abstract (English)
Shopping plays a significant role in shaping consumer identity and social integration. However, for individuals with visual impairments, navigating in supermarkets and identifying products can be an overwhelming and challenging experience. This paper presents an AI-based shopping assistant prototype designed to enhance the autonomy and inclusivity of visually impaired individuals in supermarket environments. The system integrates multiple technologies, including computer vision, speech recognition, text-to-speech synthesis, and indoor navigation, into a single, user-friendly platform. Using cameras for ArUco marker detection and real-time environmental scanning, the system helps users navigate the store, identify product locations, provide real-time auditory guidance, and gain context about their surroundings. The assistant interacts with the user through voice commands and multimodal feedback, promoting a more dynamic and engaging shopping experience. The system was evaluated through experiments, which demonstrated its ability to guide users effectively and improve their shopping experience. This paper contributes to the development of inclusive AI-driven assistive technologies aimed at enhancing accessibility and user independence for the shopping experience.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。