Rochester Institute of Technology
Optical Flow and Deep Learning Based Approach to Visual Odometry
Abstract
dc:description.abstractVisual odometry is a challenging approach to simultaneous localization and mapping algorithms. Based on one or two cameras, motion is estimated from features and pixel differences from one set of frames to the next. A different but related topic to visual odometry is optical flow, which aims to calculate the exact distance and direction every pixel moves in consecutive frames of a video sequence. Because of the frame rate of the cameras, there are generally small, incremental changes between subsequent frames, in which optical flow can be assumed to be proportional to the physical distance moved by an egocentric reference, such as a camera on a vehicle. Combining these two issues, a visual odometry system using optical flow and deep learning is proposed. Optical flow images are used as input to a convolutional neural network, which calculates a rotation and displacement based on the image. The displacements and rotations are applied incrementally in sequence to construct a map of where the camera has traveled. The system is trained and tested on the KITTI visual odometry dataset, and accuracy is measured by the difference in distances between ground truth and predicted driving trajectories. Different convolutional neural network architecture configurations are tested for accuracy, and then results are compared to other state-of-the-art monocular odometry systems using the same dataset. The average translation error from this system is 10.77%, and the average rotation error is 0.0623 degrees per meter. This system also exhibits at least a 23.796x speedup over the next fastest odometry estimation system.
Degree
thesis:*- Name thesis:degree_name
- Computer Engineering (MS)
- Level thesis:degree_level
- Thesis
- Discipline thesis:degree_discipline
- Computer Engineering (KGCOE)
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Muller, Peter M
- Contributors dc:contributor
-
- Andreas Savakis
Subjects
dc:subject × 1Identifiers
dc:identifier.*- Repository record dc:identifier
- https://repository.rit.edu/theses/9316