碩士 / 國立交通大學 / 多媒體工程研究所 / 102 / When people go to places or get into complicated indoor environments, such as supermarkets, malls, bookstores, etc., they might get lost or have no idea about how to reach desired locations or merchandises. Generally, they will ask the store stuff to guide them to the destination. In this study, an indoor navigation system based on augmented reality (AR) and computer vision techniques for applications in bookstores and libraries by the use of mobile devices is proposed.
At first, an indoor infra-structure is set up by attaching fisheye cameras on the ceiling of the navigation environment. The locations and orientations of multiple users are detected from the images acquired with the fisheye cameras by a server-side system, and the analysis results are sent to a client-side system on each user’s mobile device. Meanwhile, the server-side system analyzes as well the acquired images to recognize book items and sends the surrounding environment information, book information, and the navigation path to the client-side system. The client-side system then displays the information in an AR way, which provides clear information for each user to conduct navigation to a destination.
For book spine and cover recognition, two methods are adopted to recognize book spine and cover images, respectively. At first, the server-side system receives the image captured by the client-device camera. Secondly, an image segmentation process is performed. Finally, matching is conducted against a pre-constructed book spine/cover image database by SURF and ORB algorithms for book spine and cover recognition, respectively.
To speed up feature matching, a two-stage improvement method is proposed, which combines the multi-probe LSH method and multi-thread processing. In the first stage, all descriptors of the ORB algorithm are distributed to a pre-selected number of threads, and multiple hash tables for use by the multi-probe LSH method are constructed. In the second stage, the input features are matched against all the tables to obtain a best result.
For AR-based navigation and book information retrieval, the client-side system sends the images captured by the client-device camera to the server-side system. Then, the server-side system analyzes them by the SURF and ORB algorithms and matches the resulting features against the pre-constructed book spine/cover image database. The result with corresponding information is transmitted to the client-side system for display in an AR way. A path planning technique for generating a collision-free path from a spot to a selected book item via the use of an environment map is also employed. Finally, the navigation and book information is overlaid onto the images shown on the mobile-device screen for the user to inspect.
Good experimental results are also included to show the feasibility of the proposed system and methods; and precision measures and statistics are included to show the system’s effectiveness in handling real conditions in bookstores and libraries.
| Identifer | oai:union.ndltd.org:TW/102NCTU5641032 |
| Date | January 2014 |
| Creators | Tsai, Meng-Syun, 蔡孟勳 |
| Contributors | Tsai, Wen-Hsiung, 蔡文祥 |
| Source Sets | National Digital Library of Theses and Dissertations in Taiwan |
| Language | zh-TW |
| Detected Language | English |
| Type | 學位論文 ; thesis |
| Format | 97 |
Page generated in 0.0018 seconds