用声音提示帮助视障者定位物体,提升独立性。
SonoVision: A Computer Vision Approach for Helping Visually Challenged Individuals Locate Objects with the Help of Sound Cues
- 通过耳机左右耳的声波差异指示物体方位
- 使用EfficientDet-D2模型实现离线物体检测
- 适合视障用户在无网络环境下使用
视障者定位物体是重大挑战,影响其独立性和安全。为此,我们提出SonoVision——一款基于手机的应用程序,通过耳机发出声学提示帮助视障者定位日常物品。若物体在右侧,右耳发声;在左侧则左耳发声;正前方时双耳同时响铃。该应用基于Flutter开发,后端采用EfficientDet-D2模型进行物体检测,支持完全离线运行。通过智能手机即可实现自主定位,减少对周围人的依赖,提升安全性与独立性。项目源码可在https://github.com/MohammedZ666/SonoVision.git获取。
原文摘要 · Abstract (English)
Locating objects for the visually impaired is a significant challenge and is something no one can get used to over time. However, this hinders their independence and could push them towards risky and dangerous scenarios. Hence, in the spirit of making the visually challenged more self-sufficient, we present SonoVision, a smart-phone application that helps them find everyday objects using sound cues through earphones/headphones. This simply means, if an object is on the right or left side of a user, the app makes a sinusoidal sound in a user's respective ear through ear/headphones. However, to indicate objects located directly in front, both the left and right earphones are rung simultaneously. These sound cues could easily help a visually impaired individual locate objects with the help of their smartphones and reduce the reliance on people in their surroundings, consequently making them more independent. This application is made with the flutter development platform and uses the Efficientdet-D2 model for object detection in the backend. We believe the app will significantly assist the visually impaired in a safe and user-friendly manner with its capacity to work completely offline. Our application can be accessed here https://github.com/MohammedZ666/SonoVision.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。