Smart guiding glasses with descriptive video service and spoken dialogue system for visually impaired

摘要

This paper proposed a wearable equipment for walking navigation to help the visually impaired people. It is a pair of smart glasses combining 3D vision and microphone/speaker, which can help the visually impaired to be convenient in outdoor. We used 3D object detection and recognition to handle visual understanding. A dialogue system is developed for human/machine communication. Finally, we completed the SW/HW integration and verification. This result invited blind people to test in a real environment and continue to improve its practicality and convenience.