An Indoor Navigation System for the HoloLens Visually Impaired Using HoloLens / 利用HoloLens之盲人室內導覽輔助系統

碩士 / 國立高雄第一科技大學 / 資訊管理系碩士班 / 106 / Technology has become more and more important to help the daily activities in recent years. Especially, the blind can feel and understand the world with the sensor of mobile devices. With the rapid development of augmented reality and virtual reality techniques, there has been a lot of business opportunities through the perception of context to make human senses have new experiences. The mixed reality device such as Microsoft HoloLens can detect the 3D environment and responds to the user via voice instructions. This technology can be applied to blind people for more convenience in daily moves.
In this study, we have implemented a blind indoor navigation system with Microsoft HoloLens. We can get the camera's coordinates and direction of HoloLens and create indoor 3D models, detect distance from obstacles. In addition, HoloLens also provides the functions of gaze detection, image recognition, audio processing for speech recognition and output. This study attempts to develop a blind indoor navigation system using these basic functions of HoloLens. The system can provide various blind guidance functions such as planning of safety paths, display the near targets, and BB sound warnings when walking beyond the safe path range. It can also show the recognition results of the gaze object and the distance.
The developed system mainly controls the activities and functions through voice commands. To evaluate the system performance, we invited 8 testers to use the indoor navigation system to guide users through voice commands. After the experiments, the testers filled in the scores and opinions of a questionnaire. The results of the experiment showed better performances in the BB sound, distance speech, indoor navigation and whether it was helpful to the blind. In the future, we hope we can improve the designed functions so as to provide a better navigation tool for blind people.

Identiferoai:union.ndltd.org:TW/106NKIT0396024
Date January 2018
CreatorsLEE, CHIEN-YI, 李建毅
ContributorsLEE, JIA-HONG, 李嘉紘
Source SetsNational Digital Library of Theses and Dissertations in Taiwan
Languagezh-TW
Detected LanguageEnglish
Type學位論文 ; thesis
Format63

Page generated in 0.0222 seconds