Georgia Institute of Technology
Bayesian 3D multiple people tracking using multiple indoor cameras and microphones
Abstract
dc:description.abstractThis thesis represents Bayesian joint audio-visual tracking for the 3D locations of multiple people and a current speaker in a real conference environment. To achieve this objective, it focuses on several different research interests, such as acoustic-feature detection, visual-feature detection, a non-linear Bayesian framework, data association, and sensor fusion. As acoustic-feature detection, time-delay-of-arrival~(TDOA) estimation is used for multiple source detection. Localization performance using TDOAs is also analyzed according to different configurations of microphones. As a visual-feature detection, Viola-Jones face detection is used to initialize the locations of unknown multiple objects. Then, a corner feature, based on the results from the Viola-Jones face detection, is used for motion detection for robust objects. Simple point-to-line correspondences between multiple cameras using fundamental matrices are used to determine which features are more robust. As a method for data association and sensor fusion, Monte-Carlo JPDAF and a data association with IPPF~(DA-IPPF) are implemented in the framework of particle filtering. Three different tracking scenarios of acoustic source tracking, visual source tracking, and joint acoustic-visual source tracking are represented using the proposed algorithms. Finally the real-time implementation of this joint acoustic-visual tracking system using a PC, four cameras, and six microphones is addressed with two parts of system implementation and real-time processing.
Degree
thesis:*- Department dc:contributor.department
- Electrical and Computer Engineering
- Grantor dc:publisher
- Georgia Institute of Technology
- Year dc:date.issued
- 2009
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Lee, Yeongseon
- Advisor dc:contributor.advisor
-
- Mersereau, Russell M.
- Committee members dc:contributor.committeemember
-
- Biing Hwang Juang
- Christopher E. Heil
- Georgia Vachtsevanos
- McClellan, James H.
Subjects
dc:subject × 14- Object tracking
- Particle filter
- Data association
- Sensor fusion
- Visual feature detection
- TDOA detection
- Multiple target tracking
- Automatic tracking
- Sensor networks
- Multisensor data fusion
- Context-aware computing
- Human face recognition (Computer science)
- Motion perception (Vision) Computer networks
- Acoustic localization
Identifiers
dc:identifier.*- Handle dc:identifier.uri
- http://hdl.handle.net/1853/29668